2d digital image capture system and simulating 3d digital image and sequence

ABSTRACT

A system to capture a plurality of two dimensional digital source images of scene by user, a smart device having a memory device for storing an instruction, a processor in communication with the memory and configured to execute the instruction, a plurality of digital image capture devices in communication with the processor and each image capture device configured to capture a digital image of the scene, the plurality of digital image capture devices positioned linearly in series within approximately an interpupillary distance, wherein a first digital image capture devices is centered proximate a first end of the interpupillary distance, a second digital image capture devices is centered on a second end of the interpupillary distance, and any remaining the plurality of digital image capture devices are evenly spaced therebetween, a display in communication with the processor, display configured to display multidimensional digital image sequence and add audio file thereto.

CROSS REFERENCE To RELATED APPLICATIONS

To the full extent permitted by law, the present United StatesNon-Provisional Patent Application claims priority to and the fullbenefit of U.S. Provisional Application No. 63/197,941, filed on Jun. 7,2021 entitled “AUDIO, DIGY SEQUENCE, NFT AND METHODS OF USE” (CPA12);and U.S. Provisional Application No. 63/212,025, filed on Jun. 17, 2021entitled “IMAGE CAPTURE SYSTEM AND DISPLAY OF DIGITAL MULTI-DIMENSIONALIMAGE” (CPA5B). This application is also a continuation-in-part of U.S.Non-Provisional Application No. 17/333,721, filed on May 28, 2021,entitled “2D IMAGE CAPTURE SYSTEM & DISPLAY OF 3D DIGITAL IMAGE” (RA4);U.S. Non-Provisional application Ser. No. 17/333,812, filed on May 28,2021, entitled “2D IMAGE CAPTURE SYSTEM, TRANSMISSION & DISPLAY OF 3DDIGITAL IMAGE” (RA4CON); U.S. Non-Provisional application Ser. No.17/355,906, filed on Jun. 23, 2021, entitled “2D IMAGE CAPTURE SYSTEMAND SIMULATING 3D IMAGE SEQUENCE” (RA5); U.S. Non-Provisionalapplication Ser. No. 17/525,246, filed on Nov. 12, 2021, entitled “2DDIGITAL IMAGE CAPTURE SYSTEM, FRAME SPEED, AND SIMULATING 3D DIGITALIMAGE SEQUENCE” (RASCIP); U.S. Non-Provisional application Ser. No.17/459,067, filed on Aug. 27, 2021, entitled “VEHICLE TERRAIN CAPTURESYSTEM AND DISPLAY OF 3D DIGITAL IMAGE AND 3D SEQUENCE” (RA9); and U.S.Non-Provisional application Ser. No. 17/511,490, filed on Oct. 26, 2021,entitled “SUBSURFACE IMAGING AND DISPLAY OF 3D DIGITAL IMAGE AND 3DIMAGE SEQUENCE” (RA10). This application is also a continuation-in-partof U.S. Design Patent Application No. 29/816,461, filed on Nov. 22, 2021entitled “INTERPUPILLARY DISTANCE WIDTH CAMERA” (DA3CIP); and U.S.Design Patent Application No. 29/816,462, filed on Nov. 22, 2021entitled “MOBILE DEVICE WITH AN INTERPUPILLARY DISTANCE WIDTH CAMERAARRAY” (DASCIP). This application is related to InternationalApplication No. PCT/US2021/034832, PCT/US2021/034853, PCT/US2021/038677,PCT/U52021/059165, PCT/US2021/047907, and PCT/U52021/056721. Theforegoing is incorporated herein by reference in their entirety.

FIELD OF THE DISCLOSURE

The present disclosure is directed to 2D image capture, imageprocessing, and simulating display of a 3D or multi-dimensional image orimage sequence.

BACKGROUND

The human visual system (MIS) relies on two dimensional images tointerpret three dimensional fields of view. By utilizing the mechanismswith the HVS we create images/scenes that are compatible with the HVS.

Mismatches between the point at which the eyes must converge and thedistance to which they must focus when viewing a 3D image have negativeconsequences. While 3D imagery has proven popular and useful for movies,digital advertising, many other applications may be utilized if viewersare enabled to view 3D images without wearing specialized glasses or aheadset, which is a well-known problem. Misalignment in these systemsresults in jumping images, out of focus, or fuzzy features when viewingthe digital multidimensional images. The viewing of these images canlead to headaches and nausea.

In natural viewing, images arrive at the eyes with varying binoculardisparity, so that as viewers look from one point in the visual scene toanother, they must adjust their eyes' vergence. The distance at whichthe lines of sight intersect is the vergence distance. Failure toconverge at that distance results in double images. The viewer alsoadjusts the focal power of the lens in each eye (i.e., accommodates)appropriately for the fixated part of the scene. The distance to whichthe eye must be focused is the accommodative distance. Failure toaccommodate to that distance results in blurred images. Vergence andaccommodation responses are coupled in the brain, specifically, changesin vergence drive changes in accommodation and changes in accommodationdrive changes in vergence. Such coupling is advantageous in naturalviewing because vergence and accommodative distances are nearly alwaysidentical.

In 3D images, images have varying binocular disparity therebystimulating changes in vergence as happens in natural viewing. But theaccommodative distance remains fixed at the display distance from theviewer, so the natural correlation between vergence and accommodativedistance is disrupted, leading to the so-called vergence-accommodationconflict. The conflict causes several problems. Firstly, differingdisparity and focus information cause perceptual depth distortions.Secondly, viewers experience difficulties in simultaneously fusing andfocusing on key subject within the image. Finally, attempting to adjustvergence and accommodation separately causes visual discomfort andfatigue in viewers.

Perception of depth is based on a variety of cues, with binoculardisparity and motion parallax generally providing more precise depthinformation than pictorial cues. Binocular disparity and motion parallaxprovide two independent quantitative cues for depth perception.Binocular disparity refers to the difference in position between the tworetinal image projections of a point in 3D space.

Conventional stereoscopic displays forces viewers to try to decouplethese processes, because while they must dynamically vary vergence angleto view objects at different stereoscopic distances, they must keepaccommodation at a fixed distance or else the entire display will slipout of focus. This decoupling generates eye fatigue and compromisesimage quality when viewing such displays.

Recently, a subset of photographers is utilizing 1980s cameras such asNIMSLO and NASHIKA 3D 35 mm analog film cameras or digital camera movedbetween a plurality of points to take multiple frames of a scene,develop the film of the multiple frames from the analog camera, uploadimages into image software, such as PHOTOSHOP, and arrange images tocreate a wiggle gram, moving GIF effect.

Therefore, it is readily apparent that there is a recognizable unmetneed for a smart device having an integrated 2D digital image capturesystem, image manipulation application, & display of 3D digital imagesor image sequence that may be configured to address at least someaspects of the problems discussed above.

SUMMARY

Briefly described, in an example embodiment, the present disclosure mayovercome the above-mentioned disadvantages and may meet the recognizedneed for 2D image capture system and display of 3D digital image and 3Dsequence a smart device having a memory device for storing aninstruction, a processor in communication with the memory and configuredto execute the instruction, a plurality of digital image capture devicesin communication with the processor and each image capture deviceconfigured to capture a digital image of the scene, the plurality ofdigital image capture devices positioned linearly in series withinapproximately an interpupillary distance, wherein a first digital imagecapture devices is centered proximate a first end of the interpupillarydistance, a second digital image capture devices is centered on a secondend of the interpupillary distance, and any remaining the plurality ofdigital image capture devices are evenly spaced therebetween, processingsteps to configure datasets, and a display configured to display asimulated multidimensional digital image sequence and/or amultidimensional digital image, storage of multidimensional digitalimage sequence and/or a multidimensional digital image via block chain,storage of audio files for playback while viewing the image file,storage of related verification documents authenticating image or audiofile, transmission of stored files, block chain storage of such files,creation of non-fungible assets of such stored files, non-fungible token(NFT).

Accordingly, a feature of the system and methods of use is its abilityto capture a plurality of images of a scene with 2D capture devicespositioned approximately an intraocular or interpupillary distance widthIPD apart (distance between pupils of human visual system).

Accordingly, a feature of the system and methods of use is its abilityto convert input 2D source images into multi-dimensional/multi-spectralimage sequence. The output image follows the rule of a “key subjectpoint” maintained within an optimum parallax to maintain a clear andsharp image.

Accordingly, a feature of the system and methods of use is its abilityto utilize existing viewing devices to display simulatedmultidimensional digital image sequence.

Accordingly, a feature of the system and methods of use is its abilityof taking, viewing, and sending over the internet multidimensionaldigital image sequence. This self-contained system can be integratedinto a smart phone, tablet or used with external devices. A series of 4camera lens allow us to produce a special motion parallax image, DIGY,that can be viewed without a special screen. The system can be used in afully automated mode or in manual for operator inter-action with thescene.

Accordingly, a feature of the system and methods of use is the abilityto integrate viewing devices or other viewing functionality into thedisplay, such as barrier screen (black line), lenticular, arced, curved,trapezoid, parabolic, overlays, waveguides, black line and the like withan integrated LCD layer in an LED or OLED, LCD, OLED, and combinationsthereof or other viewing devices.

Another feature of the digital multi-dimensional image platform basedsystem and methods of use is the ability to produce digitalmulti-dimensional images that can be viewed on viewing screens, such asmobile and stationary phones, smart phones (including iPhone), tablets,computers, laptops, monitors and other displays and/or special outputdevices, directly without 3D glasses or a headset.

In an exemplary embodiment a system to simulate a 3D image sequence froma series of 2D images of a scene, the system includes a smart devicehaving a memory device for storing an instruction, a processor incommunication with said memory device configured to execute saidinstruction, a plurality of digital image capture devices incommunication with said processor and each of said plurality imagecapture devices configured to capture a digital image of the scene, saidplurality of digital image capture devices approximately positionedlinearly in series within approximately an interpupillary distancewidth, wherein a first digital image capture devices is positionedproximate a first end of said interpupillary distance width, a seconddigital image capture devices is positioned proximate a second end ofsaid interpupillary distance width, and any remaining said plurality ofdigital image capture devices are evenly spaced therebetween to capturea series of 2D images of the scene, a display in communication with saidprocessor, said display configured to display said a multidimensionaldigital image sequence, and overlay an audio file on saidmultidimensional digital image sequence via an input on said display.

A feature of the present disclosure may include a system having a seriesof capture devices, such as two, three, four or more, such plurality ofcapture devices (digital image cameras) positioned in series linearlywithin an intraocular or interpupilary distance width, the distancebetween an average human's pupils, the system captures and stores two,three, four or more, a plurality of 2D source images of a scene, thesystem labels and identifies the images based on the source capturedevice that captured the image.

A feature of the present disclosure may include a system having adisplay device configured from a stack of components, such as top glasscover, capacitive touch screen glass, polarizer, diffusers, andbacklight. Moreover, an image source, such as LCD, such LED, ELED, PDP,QLED, and other types of display technologies. Furthermore, displaydevice may include a lens array preferably positioned between capacitivetouch screen glass and LCD panel stack of components, and configured tobend or refract light in a manner capable of displaying both a highquality 2D image and an interlaced stereo pair of left and right imagesas 3D or multidimensional digital image of scene.

A feature of the present disclosure is the ability to overcome the abovedefects via another important parameter to determine the convergencepoint or key subject point, since the viewing of an image that has notbeen aligned to a key subject point causes confusion to the human visualsystem and results in blur and double images.

A feature of the present disclosure is the ability to select theconvergence point or key subject point anywhere between near or closeplane and far or back plane, manual mode user selection.

A feature of the present disclosure is the ability to overcome the abovedefects via another important parameter to determine Circle of Comfort(CoC), since the viewing of an image that has not been aligned to theCircle of Comfort (CoC) causes confusion to the human visual system andresults in blur and double images.

A feature of the present disclosure is the ability to overcome the abovedefects via another important parameter to determine Circle of Comfort(CoC) fused with Horopter arc or points and Panum area, since theviewing of an image that has not been aligned to the Circle of Comfort(CoC) fused with Horopter arc or points and Panum area causes confusionto the human visual system and results in blur and double images.

A feature of the present disclosure is the ability to overcome the abovedefects via another important parameter to determine gray scale depthmap, the system interpolates intermediate points based on the assignedpoints (closest point, key subject point, and furthest point) in ascene, the system assigns values to those intermediate points andrenders the sum to a gray scale depth map. The gray scale map togenerate volumetric parallax using values assigned to the differentpoints (closest point, key subject point, and furthest point) in ascene. This modality also allows volumetric parallax or rounding to beassigned to singular objects within a scene.

A feature of the present disclosure is its ability to measure depth orz-axis of objects or elements of objects and/or make comparisons basedon known sizes of objects in a scene.

A feature of the present disclosure is its ability to utilize a keysubject algorithm to manually or automatically select the key subject ina plurality of images of a scene displayed on a display and producemultidimensional digital image sequence for viewing on a display.

A feature of the present disclosure is its ability to utilize an imagealignment, horizontal image translation, or edit algorithm to manuallyor automatically align the plurality of images of a scene about a keysubject for display.

A feature of the feature of the present disclosure is its ability toutilize an image translation algorithm to align the key subject point oftwo images of a scene for display.

A feature of the feature of the present disclosure is its ability togenerate DIFYS (Differential Image Format) is a specific technique forobtaining multi-view of a scene and creating a series of image thatcreates depth without glasses or any other viewing aides. The systemutilizes horizontal image translation along with a form of motionparallax to create 3D viewing. DIFYS are created by having differentview of a single scene flipped by the observer's eyes. The views arecaptured by motion of the image capture system or by multiple camerastaking a scene with each of the cameras within the array viewing at adifferent position.

In accordance with a first aspect of the present disclosure ofsimulating a 3D image sequence from a sequence of 2D image frames, maybe utilized to capture(ing) a plurality of 2D image frames (images) of ascene from a plurality of different observation points, wherein a firstproximal plane and a second distal plane is identified within each imageframe in the sequence, and wherein each observation point maintainssubstantially the same first proximal image plane for each image frame;determining a depth estimate for the first proximal and second distalplane within each image frame in the sequence, aligning the firstproximal plane of each image frame in the sequence and shifting thesecond distal plane of each subsequent image frame in the sequence basedon the depth estimate of the second distal plane for each image frame,to produce a modified image frame corresponding to each 2D image frameand displaying the modified image frames sequentially.

The present disclosure varies the focus of objects at different planesin a displayed scene to match vergence and stereoscopic retinaldisparity demands to better simulate natural viewing conditions. Byadjusting the focus of key objects in a scene to match theirstereoscopic retinal disparity, the cues to ocular accommodation andvergence are brought into agreement. As in natural vision, the viewerbrings different objects into focus by shifting accommodation. As themismatch between accommodation and vergence is decreased, naturalviewing conditions are better simulated, and eye fatigue is decreased.

The present disclosure may be utilized to determine three or more planesfor each image frame in the sequence.

Furthermore, it is preferred that the planes have different depthestimates.

In addition, it is preferred that each respective plane is shifted basedon the difference between the depth estimate of the respective plane andthe first proximal plane.

Preferably, the first, proximal plane of each modified image frame isaligned such that the first proximal plane is positioned at the samepixel space.

It is also preferred that the first plane comprises a key subject point.

Preferably, the planes comprise at least one foreground plane.

In addition, it is preferred that the planes comprise at least onebackground plane.

Preferably, the sequential observation points lie on a straight line.

In accordance with a second aspect of the present invention there is anon-transitory computer readable storage medium storing instructions,the instructions when executed by a processor causing the processor toperform the method according to the second aspect of the presentinvention.

These and other features of the smart device having 2D digital imagecapture system, image manipulation application, & display of 3D digitalimage or image sequence will become more apparent to one skilled in theart from the prior Summary and following Brief Description of theDrawings, Detailed Description of exemplary embodiments thereof, andclaims when read in light of the accompanying Drawings or Figures.

BRIEF DESCRIPTION OF THE DRAWINGS

The present disclosure will be better understood by reading the DetailedDescription of the Preferred and Selected Alternate Embodiments withreference to the accompanying drawing Figures, in which like referencenumerals denote similar structure and refer to like elements throughout,and in which:

FIG. 1A illustrates a 2D rendering of an image based upon a change inorientation of an observer relative to a display;

FIG. 1B illustrates a 2D rendering of an image with binocular disparityas a result of the horizontal separation parallax of the left and righteyes;

FIG. 2A is an illustration of a cross-section view of the structure ofthe human eyeball;

FIG. 2B is a graph relating density of rods and cones to the position ofthe fovea;

FIG. 3 is a top view illustration of an observer's field of view;

FIG. 4A is a side view illustration identifying planes of a scenecaptured using a camera or other capture device;

FIG. 4B A is a front view illustration of an exemplary embodiment of twoimages of a scene in FIG. 4A captured utilizing capture devices shown inFIGS. 8G;

FIG. 5 is a top view illustration identifying planes of a scene and acircle of comfort in scale with FIG. 4 ;

FIG. 6 is a block diagram of a computer system of the presentdisclosure;

FIG. 7 is a block diagram of a communications system implemented by thecomputer system in FIG. 1 ;

FIG. 8A is a diagram of an exemplary embodiment of a computing devicewith four image capture devices positioned vertically in series linearlywithin an intraocular or interpupillary distance width, the distancebetween an average human's pupils;

FIG. 8B is a diagram of an exemplary embodiment of a computing devicewith four image capture devices positioned horizontally in serieslinearly within an intraocular or interpupillary distance width, thedistance between an average human's pupils;

FIG. 8C is an exploded diagram of an exemplary embodiment of the fourimage capture devices in series linearly of FIGS. 8A and 8B;

FIG. 8D is a cross-sectional diagram of an exemplary embodiment of thefour image capture devices in series linearly of FIGS. 8A and 8B;

FIG. 8E is an exploded diagram of an exemplary embodiment of the threeimage capture devices in series linearly within an intraocular orinterpupillary distance width, the distance between an average human'spupils;

FIG. 8F is a cross-sectional diagram of an exemplary embodiment of thethree image capture devices in series linearly of FIG. 8E;

FIG. 8G is an exploded diagram of an exemplary embodiment of the twoimage capture devices in series linearly within an intraocular orinterpupillary distance width, the distance between an average human'spupils;

FIG. 8H is a cross-sectional diagram of an exemplary embodiment of thetwo image capture devices in series linearly of FIG. 8G;

FIG. 9 is a diagram of an exemplary embodiment of human eye spacing theintraocular or interpupillary distance width, the distance between anaverage human's pupils;

FIG. 10 is a top view illustration identifying planes of a scene and acircle of comfort in scale with right triangles defining positioning ofcapture devices on lens plane;

FIG. 10A is a top view illustration of an exemplary embodimentidentifying right triangles to calculate the radius of the Circle ofComfort of FIG. 10 ;

FIG. 10B is a top view illustration of an exemplary embodimentidentifying right triangles to calculate linear positioning of capturedevices on lens plane of FIG. 10 ;

FIG. 10C is a top view illustration of an exemplary embodimentidentifying right triangles to calculate the optimum distance ofbackplane of FIG. 10 ;

FIG. 11 is a diagram illustration of an exemplary embodiment of ageometrical shift of a point between two images (frames), such as inFIG. 11A according to select embodiments of the instant disclosure;

FIG. 11A is a front top view illustration of an exemplary embodiment offour images of a scene captured utilizing capture devices shown in FIGS.8A-8F and aligned about a key subject point;

FIG. 11B is a front view illustration of an exemplary embodiment of fourimages of a scene captured utilizing capture devices shown in FIGS.8A-8F and aligned about a key subject point;

FIG. 12 is an exemplary embodiment of a flow diagram of a method ofgenerating a multidimensional image(s)/sequence captured utilizingcapture devices shown in FIGS. 8A-8H;

FIG. 13 is a top view illustration of an exemplary embodiment of adisplay with user interactive content to select photography options ofcomputer system;

FIG. 14A is a top view illustration identifying two frames capturedutilizing capture devices shown in FIGS. 8A-8F showing key subjectaligned as shown in FIG. 11B and near plane object offset between twoframes;

FIG. 14B is a top view illustration of an exemplary embodiment of leftand right eye virtual depth via object offset between two frames of FIG.14A;

FIG. 15A is a cross-section diagram of an exemplary embodiment of adisplay stack according to select embodiments of the instant disclosure;

FIG. 15B is a cross-section diagram of an exemplary embodiment of anarced or curved shaped lens according to select embodiments of theinstant disclosure, tracing RGB light there through;

FIG. 15C is a cross-section diagram of a prototype embodiment of atrapezoid shaped lens according to select embodiments of the instantdisclosure, tracing RGB light there through;

FIG. 15D is a cross-section diagram of an exemplary embodiment of a domeshaped lens according to select embodiments of the instant disclosure,tracing RGB light there through;

FIG. 16A is a diagram illustration of an exemplary embodiment of a pixelinterphase processing of images (frames), such as in FIG. 8A accordingto select embodiments of the instant disclosure;

FIG. 16B is a top view illustration of an exemplary embodiment of adisplay of computer system running an application;

FIG. 17 is a top view illustration of an exemplary embodiment of viewinga multidimensional digital image on display with the image within theCircle of Comfort, proximate Horopter arc or points, within Panum area,and viewed from viewing distance;

FIG. 18 is an exemplary embodiment of a flow diagram of a method ofgenerating a non-fungible token (NFT) utilizing a computing device withimage capture devices capture devices shown in FIGS. 8A-8H;

FIG. 19 is an exemplary embodiment of a flow diagram of a method ofselecting a sequence of DIGYs and adding an audio file thereto utilizinga computing device with image capture devices capture devices shown inFIGS. 8A-8H; and

FIG. 20 is an exemplary embodiment of a flow diagram of a method ofgenerating a DIGYs and adding an audio file thereto utilizing acomputing device with image capture devices capture devices shown inFIGS. 8A-8H.

It is to be noted that the drawings presented are intended solely forthe purpose of illustration and that they are, therefore, neitherdesired nor intended to limit the disclosure to any or all of the exactdetails of construction shown, except insofar as they may be deemedessential to the claimed disclosure.

DETAILED DESCRIPTION

In describing the exemplary embodiments of the present disclosure, asillustrated in figures specific terminology is employed for the sake ofclarity. The present disclosure, however, is not intended to be limitedto the specific terminology so selected, and it is to be understood thateach specific element includes all technical equivalents that operate ina similar manner to accomplish similar functions. The claimed inventionmay, however, be embodied in many different forms and should not beconstrued to be limited to the embodiments set forth herein. Theexamples set forth herein are non-limiting examples and are merelyexamples among other possible examples.

Perception of depth is based on a variety of cues, with binoculardisparity and motion parallax generally providing more precise depthinformation than pictorial cues. Binocular disparity and motion parallaxprovide two independent quantitative cues for depth perception.Binocular disparity refers to the difference in position between the tworetinal image projections of a point in 3D space. As illustrated inFIGS. 1A and 1B, the robust precepts of depth that are obtained whenviewing an object 102 in an image scene 110 demonstrates that the braincan compute depth from binocular disparity cues alone. In binocularvision, the Horopter 112 is the locus of points in space that have thesame disparity as the fixation point 114. Objects lying on a horizontalline passing through the fixation point 114 results in a single image,while objects a reasonable distance from this line result in two images116, 118.

Classical motion parallax is dependent upon two eye functions. One isthe tracking of the eye to the motion (eyeball moves to fix motion on asingle spot) and the second is smooth motion difference leading toparallax or binocular disparity. Classical motion parallax is when theobserver is stationary and the scene around the observer is translatingor the opposite where the scene is stationary, and the observertranslates across the scene.

By using two images 116, 118 of the same object 102 obtained fromslightly different angles, it is possible to triangulate the distance tothe object 102 with a high degree of accuracy. Each eye views a slightlydifferent angle of the object 102 seen by the left eye 104 and right eye106. This happens because of the horizontal separation parallax of theeyes. If an object is far away, the disparity 108 of that image 110falling on both retinas will be small. If the object is close or near,the disparity 108 of that image 110 falling on both retinas will belarge.

Motion parallax 120 refers to the relative image motion (between objectsat different depths) that results from translation of the observer 104.Isolated from binocular and pictorial depth cues, motion parallax 120can also provide precise depth perception, provided that it isaccompanied by ancillary signals that specify the change in eyeorientation relative to the visual scene 110. As illustrated, as eyeorientation 104 changes, the apparent relative motion of the object 102against a background gives hints about its relative distance. If theobject 102 is far away, the object 102 appears stationary. If the object102 is close or near, the object 102 appears to move more quickly.

In order to see the object 102 in close proximity and fuse the image onboth retinas into one object, the optical axes of both eyes 104, 106converge on the object 102. The muscular action changing the focallength of the eye lens so as to place a focused image on the fovea ofthe retina is called accommodation. Both the muscular action and thelack of focus of adjacent depths provide additional information to thebrain that can be used to sense depth. Image sharpness is an ambiguousdepth cue. However, by changing the focused plane (looking closer and/or further than the object 102), the ambiguities are resolved.

FIGS. 2A and 2B show the anatomy of the eye 200 and a graphicalrepresentation of the distribution of rods and cones, respectively. Thefovea 202 is responsible for sharp central vision (also referred to asfoveal vision), which is necessary where visual detail is of primaryimportance. The fovea 202 is the depression in the inner retinal surface205, about 1.5 mm wide and is made up entirely of cones 204 specializedfor maximum visual acuity. Rods 206 are low intensity receptors thatreceive information in grey scale and are important to peripheralvision, while cones 204 are high intensity receptors that receiveinformation in color vision. The importance of the fovea 202 will beunderstood more clearly with reference to FIG. 2B, which shows thedistribution of cones 204 and rods 206 in the eye 200. As shown, a largeproportion of cones 204, providing the highest visual acuity, lie withina 1.5° angle around the center of the fovea 202.

The importance of the fovea 202 will be understood more clearly withreference to FIG. 2B, which shows the distribution of cones 204 and rods206 in the eye 200. As shown, a large proportion of cones 204, providingthe highest visual acuity, lie within a 1.5° angle around the center ofthe fovea 202.

FIG. 3 illustrates a typical field of view 300 of the human visualsystem (HVS). As shown, the fovea 202 sees only the central 1.5°(degrees) of the visual field 302, with the preferred field of view 304lying within ±15° (degrees) of the center of the fovea 202. Focusing anobject on the fovea, therefore, depends on the linear size of the object102, the viewing angle and the viewing distance. A large object 102viewed in close proximity will have a large viewing angle fallingoutside the foveal vision, while a small object 102 viewed at a distancewill have a small viewing angle falling within the foveal vision. Anobject 102 that falls within the foveal vision will be produced in themind's eye with high visual acuity. However, under natural viewingconditions, viewers do not just passively perceive. Instead, theydynamically scan the visual scene 110 by shifting their eye fixation andfocus between objects at different viewing distances. In doing so, theoculomotor processes of accommodation and vergence (the angle betweenlines of sight of the left eye 104 and right eye 106) must be shiftedsynchronously to place new objects in sharp focus in the center of eachretina. Accordingly, nature has reflexively linked accommodation andvergence, such that a change in one process automatically drives amatching change in the other.

FIG. 4A illustrates a typical view of a scene S to be captured by acamera or digital image capture device, such as image capture module830. Scene S may include four planes defined as: (1) Lens frame isdefined as the plane passing through the lens or sensor (image capturemodule 830) in the recording device or camera, (2) Key Subject plane KSPmay be the plane passing through the focal point of the sensor in thescene (here couple in the scene, the Key Subject KS of the scene S), (3)Near Plane NP may be the plane passing through the closest point infocus to the lens plane (the bush B in the foreground), and (4) FarPlane FP which is the plane passing through the furthest point in focus(tree T in the background). The relative distances from image capturemodule 830 are denoted by N, Ks, B. Depth of field of the scene S isdefined by the distance between Near Plane NP and Far Plane FP.

As described above, the sense of depth of a stereoscopic image variesdepending on the distance between the camera and the key subject, knownas the image capturing distance or KS. The sense of depth is alsocontrolled by the vergence angle and the intraocular distance betweenthe capture of each successive image by the camera which effectsbinocular disparity.

In photography the Circle of Confusion defines the area of a scene Sthat is captured in focus. Thus, the near plane NP, key subject planeKSP and the far plane FP are in focus. Areas outside this circle areblurred.

FIG. 4B illustrates a typical view of a scene S to be captured by acamera or digital image capture device, such as image capture module830, more specifically image capture module 830 shown in FIG. 8G. Twoimage capture devices 831 and 832, or any other selected pair 831, 832,833, 834 may be utilized to capture plurality of digital images of sceneS as left image 810L and right image 810R of scene S, shown in FIG. 8A(plurality of digital images). Alternatively, computer system 10 viaimage manipulation application and display 208 may be configured toenable user U to select or identify two image capture devices of imagecapture devices 831 (1), 832 (2), 833 (3), or 834 (4) to capture twodigital images of scene S as left image 810L and right image 810R ofscene S. User U may tap or other identification interaction withselection box 812 to select or identify key subject KS in the sourceimages, left image 810L and right image 810R of scene S, as shown inFIG. 4B

FIG. 5 illustrates a Circle of Comfort (CoC) in scale with FIGS. 4.1 and3.1 . Defining the Circle of Comfort (CoC) as the circle formed bypassing the diameter of the circle along the perpendicular to KeySubject plane KSP (in scale with FIG. 4 ) with a width determined by the30 degree radials of FIG. 3 ) from the center point on the lens plane,image capture module 830. (R is the radius of Circle of Comfort (CoC).)

Conventional stereoscopic displays forces viewers to try to decouplethese processes, because while they must dynamically vary vergence angleto view objects at different stereoscopic distances, they must keepaccommodation at a fixed distance or else the entire display will slipout of focus. This decoupling generates eye fatigue and compromisesimage quality when viewing such displays.

In order to understand the present disclosure certain variables, need tobe defined. The object field is the entire image being composed. The“key subject point” is defined as the point where the scene converges,i.e., the point in the depth of field that always remains in focus andhas no parallax differential in the key subject point. The foregroundand background points are the closest point and furthest point from theviewer, respectively. The depth of field is the depth or distancecreated within the object field (depicted distance from foreground tobackground). The principal axis is the line perpendicular to the scenepassing through the key subject point. The parallax or binoculardisparity is the difference in the position of any point in the firstand last image after the key subject alignment. In digital composition,the key subject point displacement from the principal axis betweenframes is always maintained as a whole integer number of pixels from theprincipal axis. The total parallax is the summation of the absolutevalue of the displacement of the key subject point from the principalaxis in the closest frame and the absolute value of the displacement ofthe key subject point from the principal axis in the furthest frame.

When capturing images herein, applicant refers refer to depth of fieldor circle of confusion and circle of comfort is referred to when viewingimage on the viewing device.

U.S. Pat. Nos. 9,992,473, 10,033,990, and 10,178,247 are incorporatedherein by reference in their entirety.

Creating depth perception using motion parallax is known. However, inorder to maximize depth while maintaining a pleasing viewing experience,a systematic approach is introduced. The system combines factors of thehuman visual system with image capture procedures to produce a realisticdepth experience on any 2D viewing device.

The technique introduces the Circle of Comfort (CoC) that prescribe thelocation of the image capture system relative to the scene S. The Circleof Comfort (CoC) relative to the Key Subject KS (point of convergence,focal point) sets the optimum near plane NP and far plane FP, i.e.,controls the parallax of the scene S.

The system was developed so any capture device such as iPhone, camera orvideo camera can be used to capture the scene. Similarly, the capturedimages can be combined and viewed on any digital output device such assmart phone, tablet, monitor, TV, laptop, or computer screen.

As will be appreciated by one of skill in the art, the presentdisclosure may be embodied as a method, data processing system, orcomputer program product. Accordingly, the present disclosure may takethe form of an entirely hardware embodiment, entirely softwareembodiment or an embodiment combining software and hardware aspects.Furthermore, the present disclosure may take the form of a computerprogram product on a computer-readable storage medium havingcomputer-readable program code means embodied in the medium. Anysuitable computer readable medium may be utilized, including hard disks,ROM, RAM, CD-ROMs, electrical, optical, magnetic storage devices and thelike.

The present disclosure is described below with reference to flowchartillustrations of methods, apparatus (systems) and computer programproducts according to embodiments of the present disclosure. It will beunderstood that each block or step of the flowchart illustrations, andcombinations of blocks or steps in the flowchart illustrations, can beimplemented by computer program instructions or operations. Thesecomputer program instructions or operations may be loaded onto a generalpurpose computer, special purpose computer, or other programmable dataprocessing apparatus to produce a machine, such that the instructions oroperations, which execute on the computer or other programmable dataprocessing apparatus, create means for implementing the functionsspecified in the flowchart block or blocks/step or steps.

These computer program instructions or operations may also be stored ina computer-usable memory that can direct a computer or otherprogrammable data processing apparatus to function in a particularmanner, such that the instructions or operations stored in thecomputer-usable memory produce an article of manufacture includinginstruction means which implement the function specified in theflowchart block or blocks/step or steps. The computer programinstructions or operations may also be loaded onto a computer or otherprogrammable data processing apparatus (processor) to cause a series ofoperational steps to be performed on the computer or other programmableapparatus (processor) to produce a computer implemented process suchthat the instructions or operations which execute on the computer orother programmable apparatus (processor) provide steps for implementingthe functions specified in the flowchart block or blocks/step or steps.

Accordingly, blocks or steps of the flowchart illustrations supportcombinations of means for performing the specified functions,combinations of steps for performing the specified functions, andprogram instruction means for performing the specified functions. Itshould also be understood that each block or step of the flowchartillustrations, and combinations of blocks or steps in the flowchartillustrations, can be implemented by special purpose hardware-basedcomputer systems, which perform the specified functions or steps, orcombinations of special purpose hardware and computer instructions oroperations.

Computer programming for implementing the present disclosure may bewritten in various programming languages, database languages, and thelike. However, it is understood that other source or object orientedprogramming languages, and other conventional programming language maybe utilized without departing from the spirit and intent of the presentdisclosure.

Referring now to FIG. 6 , there is illustrated a block diagram of acomputer system 10 that provides a suitable environment for implementingembodiments of the present disclosure. The computer architecture shownin FIG. 6 is divided into two parts—motherboard 600 and the input/output(I/O) devices 620. Motherboard 600 preferably includes subsystems orprocessor to execute instructions such as central processing unit (CPU)602, a memory device, such as random access memory (RAM) 604,input/output (I/O) controller 608, and a memory device such as read-onlymemory (ROM) 606, also known as firmware, which are interconnected bybus 10. A basic input output system (BIOS) containing the basic routinesthat help to transfer information between elements within the subsystemsof the computer is preferably stored in ROM 606, or operably disposed inRAM 604. Computer system 10 further preferably includes I/O devices 620,such as main storage device 634 for storing operating system 626 andexecutes an instruction via application program(s) 624, and display 628for visual output, and other I/O devices 632 as appropriate. Mainstorage device 634 preferably is connected to CPU 602 through a mainstorage controller (represented as 608) connected to bus 610. Networkadapter 630 allows the computer system to send and receive data throughcommunication devices or any other network adapter capable oftransmitting and receiving data over a communications link that iseither a wired, optical, or wireless data pathway. It is recognizedherein that central processing unit (CPU) 602 performs instructions,operations or commands stored in ROM 606 or RAM 604.

It is contemplated herein that computer system 10 may include smartdevices, such as smart phone, iPhone, android phone (Google, Samsung, orother manufactures), tablets, desktops, laptops, digital image capturedevices, and other computing devices with two or more digital imagecapture devices and/or 3D display 608 (smart device).

It is further contemplated herein that display 608 may be configured asa foldable display or multi-foldable display capable of unfolding into alarger display surface area.

Many other devices or subsystems or other I/O devices 632 may beconnected in a similar manner, including but not limited to, devicessuch as microphone, speakers, flash drive, CD-ROM player, DVD player,printer, main storage device 634, such as hard drive, and/or modem eachconnected via an I/O adapter. Also, although preferred, it is notnecessary for all of the devices shown in FIG. 6 to be present topractice the present disclosure, as discussed below. Furthermore, thedevices and subsystems may be interconnected in different configurationsfrom that shown in FIG. 6 , or may be based on optical or gate arrays,or some combination of these elements that is capable of responding toand executing instructions or operations. The operation of a computersystem such as that shown in FIG. 6 is readily known in the art and isnot discussed in further detail in this application, so as not toovercomplicate the present discussion.

Referring now to FIG. 7 , there is illustrated a diagram depicting anexemplary communication system 700 in which concepts consistent with thepresent disclosure may be implemented. Examples of each element withinthe communication system 700 of FIG. 7 are broadly described above withrespect to FIG. 6 . In particular, the server system 760 and user system720 have attributes similar to computer system 10 of FIG. 6 andillustrate one possible implementation of computer system 10.Communication system 700 preferably includes one or more user systems720, 722, 724 (It is contemplated herein that computer system 10 mayinclude smart devices, such as smart phone, iPhone, android phone(Google, Samsung, or other manufactures), tablets, desktops, laptops,cameras, and other computing devices with display 628 (smart device)),one or more server system 760, and network 750, which could be, forexample, the Internet, public network, private network or cloud. Usersystems 720-724 each preferably includes a computer-readable medium,such as random access memory 604, 606, coupled to a processor. Theprocessor, CPU 702, executes program instructions or operations(application software 624) stored in memory 604, 606. Communicationsystem 700 typically includes one or more user system 720. For example,user system 720 may include one or more general-purpose computers (e.g.,personal computers), one or more special purpose computers (e.g.,devices specifically programmed to communicate with each other and/orthe server system 760), a workstation, a server, a device, a digitalassistant or a “smart” cellular telephone or pager, a digital camera, acomponent, other equipment, or some combination of these elements thatis capable of responding to and executing instructions or operations.

Similar to user system 720, server system 760 preferably includes acomputer-readable medium, such as random access memory 604, 606, coupledto a processor. The processor executes program instructions stored inmemory 604, 606. Server system 760 may also include a number ofadditional external or internal devices, such as, without limitation, amouse, a CD-ROM, a keyboard, a display, a storage device and otherattributes similar to computer system 10 of FIG. 6 . Server system 760may additionally include a secondary storage element, such as database770 for storage of data and information. Server system 760, althoughdepicted as a single computer system, may be implemented as a network ofcomputer processors. Memory 604, 606 in server system 760 contains oneor more executable steps, program(s), algorithm(s), or application(s)624 (shown in FIG. 6 ). For example, the server system 760 may include aweb server, information server, application server, one or moregeneral-purpose computers (e.g., personal computers), one or morespecial purpose computers (e.g., devices specifically programmed tocommunicate with each other), a workstation or other equipment, or somecombination of these elements that is capable of responding to andexecuting instructions or operations.

Communications system 700 is capable of delivering and exchanging data(including three-dimensional 3D image files) between user systems 720and a server system 760 through communications link 740 and/or network750. Through user system 720, users can preferably communicate data overnetwork 750 with each other user system 720, 722, 724, and with othersystems and devices, such as server system 760, to electronicallytransmit, store, print and/or view multidimensional digital masterimage(s). Communications link 740 typically includes network 750 makinga direct or indirect communication between the user system 720 and theserver system 760, irrespective of physical separation. Examples of anetwork 750 include the Internet, cloud, analog or digital wired andwireless networks, radio, television, cable, satellite, and/or any otherdelivery mechanism for carrying and/or transmitting data or otherinformation, such as to electronically transmit, store, print and/orview multidimensional digital master image(s). The communications link740 may include, for example, a wired, wireless, cable, optical orsatellite communication system or other pathway.

Referring again to FIG. 2A, 5, 8A-8F, and 14B for best results andsimplified math, the intraocular distance between the capture ofsuccessive images or frames of the scene S is fixed to match the averageseparation of the human left and right eyes in order to maintainconstant binocular disparity. In addition, the distance to key subjectKS is chosen such that the captured image of the key subject is sized tofall within the foveal vision of the observer in order to produce highvisual acuity of the key subject and to maintain a vergence angle equalto or less than the preferred viewing angle of fifteen degrees (15).

FIGS. 8A-8F disclose an image or frame capture system for capturing astereoscopic image (e.g., a 2D frame of a 3D sequence) of scene S, suchas FIG. 4 . Here the image capture distance, the distance from the imagecapture system and points or planes in the scene S, such as key subjectKS and focal length of camera (i.e., zooming in and out) may be ideallyheld constant while capturing a stereoscopic image (e.g., a 2D frame ofa 3D sequence) of scene S; however, the vergence angle will varyaccordingly if the spacing between the capture devices of eachsuccessive stereoscopic image is kept constant.

Referring now to FIG. 8A, by way of example, and not limitation, thereis illustrated a computer system 10, such as smart device or portablesmart device having back side 810, a first edge, such as short edge 811and a second edge, such as long edge 812. Back side 810 may include I/Odevices 632, such as an exemplary embodiment of image capture module 830and may include one or more sensors 840 to measure distance betweencomputer system 10 and selected depths in an image or scene S (depth).Image capture module 830 may include a plurality or four digital imagecapture devices 831, 832, 833, 834 with four digital image capturedevices (positioned vertically, in series linearly within an intraocularor interpupillary distance width IPD (distance between pupils of humanvisual system within a Circle of Comfort relationship to optimizedigital multi-dimensional images for the human visual system) as to backside 810 or proximate and parallel thereto long edge 812. Interpupillarydistance width IPD is preferably the distance between an average human'spupils may have a distance between approximately two and a half inches,2.5 inches (6.35 cm), more preferably between approximately 40-80 mm,the vast majority of adults have IPDs in the range 50-75 mm, the widerrange of 45-80 mm is likely to include (almost) all adults, and theminimum IPD for children (down to five years old) is around 40 mm). Itis contemplated herein that plurality of image capture modules 830 andmay include one or more sensors 840 may be configured as combinations ofimage capture device 830 and sensor 840 configured as an integrated unitor module where sensor 840 controls or sets the depth of image capturedevice 830, whether different depths in scene S, such as foreground, andperson P or object, background, such as closest point CP, key subjectpoint KS, and a furthest point FP, shown in FIG. 4 . For referenceherein plurality of image capture devices, may include first digitalimage capture device 831 centered proximate first end IPD IPD.1 ofinterpupillary distance width IPD, fourth digital image capture device834 centered proximate second end IPD.2 of interpupillary distance widthIPD, and remaining digital image capture devices second digital imagecapture device 832 and third digital image capture device 833 evenlyspaced therebetween first end IPD IPD.1 and second end IPD.2 ofinterpupillary distance width IPD, respectively.

It is contemplated herein that smart device or portable smart devicewith a display may be configured as rectangular or square or other likeconfigurations providing a surface area having first edge 811 and secondedge 812.

It is contemplated herein that digital image capture devices 831-834 orimage capture module 830 may be surrounded by recessed, stepped, orbeveled edge 814, each image capture devices 831-34 may be encircled byrecessed, stepped, or beveled ring 816, and digital image capturedevices 831-34 or image capture module 830 may be covered by lens cover820 with a lens thereunder lens 818.

It is contemplated herein that digital image capture devices 831-34 maybe individual capture devices and not part of image capture module.

It is further contemplated herein that digital image capture devices831-34 may be positioned anywhere on back side 810 and generallyparallel thereto long edge 812.

It is contemplated herein that image capture devices may includeadditional capture devices positioned within an intraocular orinterpupillary distance width IPD.

It is further contemplated herein that digital image capture devices831-34 may be utilized to capture a series of 2D images of the scene S.

Referring now to FIG. 8B, by way of example, and not limitation, thereis illustrated a computer system 10 or other smart device or portablesmart device having back side 810, short edge 811 and a long edge 812.Back side 810 may include I/O devices 632, such as an exemplaryembodiment of image capture module 830 and may include one or moresensors 840 to measure distance between computer system 10 and selecteddepths in an image or scene S (depth). Image capture module 830 mayinclude a plurality or four digital image capture devices 831, 832, 833,834 with four digital image capture devices (positioned vertically, inseries linearly within an intraocular or interpupillary distance widthIPD (distance between pupils of human visual system within a Circle ofComfort relationship to optimize digital multi-dimensional images forthe human visual system) as to back side 810 or proximate and parallelthereto short edge 812. It is contemplated herein that plurality ofimage capture modules 830 and may include one or more sensors 840 may beconfigured as combinations of image capture device 830 and sensor 840configured as an integrated unit or module where sensor 840 controls orsets the depth of image capture device 830, such as different depths inscene S, such as foreground, background, and person P or object, such asclosest point CP, key subject point KS, and furthest point FP, shown inFIG. 4 . For reference herein plurality of image capture devices, mayinclude first digital image capture device 831 centered proximate firstend IPD IPD.1 of interpupillary distance width IPD, fourth digital imagecapture device 834 centered proximate second end IPD.2 of interpupillarydistance width IPD, and remaining image capture devices second digitalimage capture device 832 and third digital image capture device 833evenly spaced therebetween first end IPD IPD.1 and second end IPD.2 ofinterpupillary distance width IPD.

It is contemplated herein that digital image capture devices 831-34 orimage capture module 830 may be surrounded by recessed, stepped, orbeveled edge 814, each image capture devices 831-34 may be encircled byrecessed, stepped, or beveled ring 816, and image capture devices 831-34or image capture module 830 may be covered by lens cover 820 with a lensthereunder lens 818.

It is contemplated herein that digital image capture devices 831-34 maybe individual capture devices and not part of image capture module.

It is further contemplated herein that digital image capture devices831-34 may be positioned anywhere on back side 810 and generallyparallel thereto long edge 812.

It is further contemplated herein that digital image capture devices831-34 may be utilized to capture a series of 2D images of the scene S.

With respect to computer system 10 and image capture devices 830, it isto be realized that the optimum dimensional relationships, to includevariations in size, materials, shape, form, position, connection,function and manner of operation, assembly and use, are intended to beencompassed by the present disclosure.

In this disclosure interpupillary distance width IPD may have ameasurement of width to position digital image capture devices 831-334center-to-center within between approximately maximum width of 115millimeter to a minimum width of 50 millimeter; more preferablyapproximately maximum width of 72.5 millimeter to a minimum width of53.5 millimeter; and most preferably between approximately maximum meanwidth of 64 millimeter to a minimum mean width of 61.7 millimeter, andan average width of 63 millimeter (2.48 inches) center-to-center widthof the human visual system shown in FIG. 9 .

Referring again to FIGS. 1A, 1B, 2A, 5, 9, 14B binocular disparity is astereognostic perception factor that occurs as a result of the averageseparation of the left and right eyes by approximately 64 mm. Whenbinocular disparity is comparatively large, the observer has the sensethat the distance to the key subject is relatively close. When thebinocular disparity is comparatively small, the observer has the sensethat the distance to the key subject KS is relatively far or large. Thevergence angle V refers to the angle between the left and right eyeshaving the key subject as a vertex when the eyes are focused on the keysubject KS. As the vergence angle increases (as both eyes rotateinward), the distance of the key subject KS is perceived by the observeras being relatively small. As the vergence angle decreases (as both eyesrotate outward), the distance of the key subject KS is perceived by theobserver as being relatively large.

Referring now to FIG. 8C, by way of example, and not limitation, thereis illustrated an exploded diagram of an exemplary embodiment of imagecapture module 830. Image capture module 830 may include digital imagecapture devices 831-834 with four image capture devices in serieslinearly within an intraocular or interpupillary distance width IPD, thedistance between an average human's pupil. Digital image capture devices831-834 may include first digital image capture device 831, seconddigital image capture device 832, third digital image capture device833, fourth digital image capture device 834. First digital imagecapture device 831 may be centered proximate first end IPD IPD.1 ofinterpupillary distance width IPD, fourth digital image capture device834 may be centered proximate second end IPD.2 of interpupillarydistance width IPD, and remaining digital image capture devices, such assecond digital image capture device 832 and third digital image capturedevice 833 may be positioned or evenly spaced therebetween first end IPDIPD.1 and second end IPD.2 of interpupillary distance width IPD. In oneembodiment each digital image capture devices 831-834 or lens 818 maysurrounded by beveled edge 814, encircled by ring 816, and/or covered bylens cover 820 with a lens thereunder lens 818.

It is further contemplated herein that digital image capture devices831-34 may be utilized to capture a series of 2D images of the scene S.

Referring now to FIG. 8D, by way of example, and not limitation, thereis illustrated a cross-sectional diagram of an exemplary embodiment ofimage capture module 830, of FIG. 8C. Image capture module 830 mayinclude digital image capture devices 831-834 with four image capturedevices in series linearly within an intraocular or interpupillarydistance width IPD, the distance between an average human's pupil.Digital image capture devices 831-834 may include first digital imagecapture device 831, second digital image capture device 832, thirddigital image capture device 833, fourth digital image capture device834. Each digital image capture devices 831-834 or lens 818 may besurrounded by beveled edge 814, encircled by ring 816, and/or covered bylens cover 820 with a lens thereunder lens 818. It is contemplatedherein that digital image capture devices 831-834 may include opticalmodule, such as lens 818 configured to focus light from scene S onsensor module, such as image capture sensor 822 configured to generateimage signals of captured image of scene S, and data processing module824 configured to generate image data for the captured image on thebasis of the generated image signals from image capture sensor 822.

It is contemplated herein that other sensor components 822 to generateimage signals for the captured image of scene S and other dataprocessing module 824 to process or manipulate the image data may beutilized herein.

It is contemplated herein that when sensor 840 is not utilized tocalculate different depths in scene S (distance from digital imagecapture devices 831-834 to foreground, background, and person P orobject, such as closest point CP, key subject point KS, and furthestpoint FP, shown in FIG. 4 ) then a user may be prompted to capture thescene S images a set distance from digital image capture devices 831-834to key subject point KS in a scene S, including but not limited to sixfeet (6 ft.) distance from closest point CP or key subject KS point of ascene S.

It is further contemplated herein that digital image capture devices831-34 may be utilized to capture a series of 2D images of the scene S.

Referring now to FIG. 8E, by way of example, and not limitation, thereis illustrated an exploded diagram of an exemplary embodiment of imagecapture module 830. Image capture module 830 may include digital imagecapture devices 831-833 with a plurality or three image capture devicesin series linearly within an intraocular or interpupillary distancewidth IPD, the distance between an average human's pupil. Digital imagecapture devices 831-833 may include first digital image capture device831, second digital image capture device 832, and third digital imagecapture device 833. First digital image capture device 831 may becentered proximate first end IPD IPD.1 of interpupillary distance widthIPD, third digital image capture device 833 may be centered proximatesecond end IPD.2 of interpupillary distance width IPD, and remainingimage capture devices, such as second digital image capture device 832may be centered on center line CL therebetween first end IPD IPD.1 andsecond end IPD.2 of interpupillary distance width IPDE. In oneembodiment each digital image capture devices 831-834 or lens 818 maysurrounded by beveled edge 814, encircled by ring 816, and/or covered bylens cover 820 with a lens thereunder lens 818.

It is further contemplated herein that digital image capture devices831-833 may be utilized to capture a series of 2D images of the scene S.

Referring now to FIG. 8F, by way of example, and not limitation, thereis illustrated a cross-sectional diagram of an exemplary embodiment ofimage capture module 830, of FIG. 8E. Image capture module 830 mayinclude digital image capture devices 831-833 with three image capturedevices in series linearly within an intraocular or interpupillarydistance width IPD, the distance between an average human's pupil.Digital image capture devices 831-833 may include first digital imagecapture device 831, second digital image capture device 832, and thirddigital image capture device 833. Each digital image capture devices831-833 or lens 818 may be surrounded by beveled edge 814, encircled byring 816, and/or covered by lens cover 820 with a lens thereunder lens818. It is contemplated herein that digital image capture devices831-833 may include optical module, such as lens 818 configured to focusan image of scene S on sensor module, such as image capture sensor 822configured to generate image signals for the captured image of scene S,and data processing module 824 configured to generate image data for thecaptured image on the basis of the generated image signals from imagecapture sensor 822.

Referring now to FIG. 8G, by way of example, and not limitation, thereis illustrated an exploded diagram of an exemplary embodiment of imagecapture module 830. Image capture module 830 may include a plurality ortwo digital image capture devices 831-832 with two image capture devicesin series linearly within an intraocular or interpupillary distancewidth IPD, the distance between an average human's pupil. Image capturedevices 831-832 may include first image capture device 831 and secondimage capture device 832. First image capture device 831 may be centeredproximate first end IPD IPD.1 of interpupillary distance width IPD andsecond image capture device 832 may be centered proximate second endIPD.2 of interpupillary distance width IPD. In one embodiment each imagecapture devices 831-832 or lens 818 may surrounded by beveled edge 814,encircled by ring 816, and/or covered by lens cover 820 with a lensthereunder lens 818.

Referring now to FIG. 8H, by way of example, and not limitation, thereis illustrated an cross-sectional diagram of an exemplary embodiment ofimage capture module 830, of FIG. 8G. Image capture module 830 mayinclude digital or image capture devices 831-832 with two image capturedevices in series linearly within an intraocular or interpupillarydistance width IPD, the distance between an average human's pupil. Imagecapture devices 831-832 may include first image capture device 831 andsecond image capture device 832. Each image capture devices 831-832 orlens 818 may be surrounded by beveled edge 814, encircled by ring 816,and/or covered by lens cover 820 with a lens thereunder lens 818. It iscontemplated herein that image capture devices 831-832 may includeoptical module, such as lens 818 configured to focus an image of scene Son sensor module, such as image capture sensor 822 configured togenerate image signals for the captured image of scene S, and dataprocessing module 824 configured to generate image data for the capturedimage on the basis of the generated image signals from image capturesensor 822.

It is contemplated herein that other sensor components to generate imagesignals for the captured image of scene S and other data processingmodule 824 to process or manipulate the image data may be utilizedherein.

It is contemplated herein that image capture module 830 and/or digitalimage capture devices 831-834 are used to obtain offset 2D digital imageviews of scene S. Moreover, it is further contemplated herein that imagecapture module 830 may include a plurality of image capture devicesother than the number set forth herein, provided plurality of imagecapture devices is positioned approximately within intraocular orinterpupillary distance width IPD, the distance between an averagehuman's pupil. Furthermore, it is further contemplated herein that imagecapture module 830 may include a plurality of image capture devicespositioned within a linear distance approximately equal tointerpupillary distance width IPD. Still furthermore, it is furthercontemplated herein that image capture module 830 may include aplurality of image capture devices positioned vertically (computersystem 10 or other smart device or portable smart device having shortedge 811), horizontally (computer system 10 or other smart device orportable smart device having long edge 812) or otherwise positionedspaced apart in series linearly and within approximately within a lineardistance approximately equal to interpupillary distance width IPD.

It is further contemplated herein that image capture module 830 anddigital image capture devices 831-34 positioned linearly within theintraocular or interpupillary distance width IPD enables accurate sceneS reproduction therein display 628 to produce a multidimensional digitalimage on display 628.

Referring now to FIG. 9 , by way of example, and not limitation, thereis illustrated a front facial view of a human with left eye LE and righteye RE and each having a midpoint of a pupil P1, P2 to illustrate thehuman eye spacing or the intraocular or interpupillary distance IPDwidth, the distance between an average human's visual system pupils.Interpupillary distance (IPD) is the distance measured inmillimeters/inches between the centers of the pupils of the eyes. Thismeasurement is different from person to person and also depends onwhether they are looking at near objects or far away. Plmay berepresented by first end IPD.1 of interpupillary distance width IPD andPS may be represented by second end IPD.2 of interpupillary distancewidth IPD. Interpupillary distance width IPD is preferably the distancebetween an average human's pupils may have a distance betweenapproximately two and a half inches, 2.5 inches (6.35 cm), morepreferably between approximately 40-80 mm, the vast majority of adultshave IPDs in the range 50-75 mm, the wider range of 45-80 mm is likelyto include (almost) all adults, and the minimum IPD for children (downto five years old) is around 40 mm).

It is contemplated herein that left and right images may be produce asset forth in FIGS. 6.1-6.3 from U.S. Pat. No. 9,992,473, 10,033,990, and10,178,247 and electrically communicated to left pixel 550L and rightpixel 550R. Moreover, 2D image may be electrically communicated tocenter pixel 550C.

Referring now to FIG. 10 , there is illustrated by way of example, andnot limitation a representative illustration of Circle of Comfort (CoC)in scale with FIGS. 4 and 3 . For the defined plane, the image capturedon the lens plane will be comfortable and compatible with human visualsystem of user U viewing the final image displayed on display 628 if asubstantial portion of the image(s) are captured within the Circle ofComfort (CoC). Any object, such as near plane N, key subject plane KSP,and far plane FP captured by two image capture devices, such as imagecapture devices 831-833 or image capture devices 831-834 (interpupillarydistance IPD) within the Circle of Comfort (CoC) will be in focus to theviewer when reproduced as digital multi-dimensional image sequenceviewable on display 628. The back-object plane or far plane FP may bedefined as the distance to the intersection of the 15 degree radial lineto the perpendicular in the field of view to the 30 degree line or R theradius of the Circle of Comfort (CoC). Moreover, defining the Circle ofComfort (CoC) as the circle formed by passing the diameter of the circlealong the perpendicular to Key Subject KS plane (KSP) with a widthdetermined by the 30 degree radials from the center point on the lensplane, image capture module 830.

Linear positioning or spacing of image capture devices, such as digitalimage capture devices 831-833, or digital image capture devices 831-834(interpupillary distance IPD) on lens plane within the 30 degree linejust tangent to the Circle of Comfort (CoC) may be utilized to createmotion parallax between the plurality of images when viewing digitalmulti-dimensional image sequence viewable on display 628, will becomfortable and compatible with human visual system of user U.

Referring now to FIG. 10A, 10B, 10C, and 11 , there is illustrated byway of example, and not limitation right triangles derived from FIG. 10. All the definitions are based on holding right triangles within therelationship of the scene to image capture. Thus, knowing the keysubject KS distance (convergence point) we can calculate the followingparameters.

FIG. 6A to calculate the radius R of Comfort (CoC).

R/KS=tan 30 degree

R=KS*tan 30 degree

FIG. 6B to calculate the optimum distance between image capture devices,such as image capture devices 831-833, or image capture devices 831-834(interpupillary distance IPD).

TR/KS=tan 15 degree

TR=KS*tan 15 degree; and IPD is 2*TR

FIG. 6C calculate the optimum far plane FP

Tan 15 degree=R/B

B=(KS*tan 30 degree)/tan 15 degree

Ratio of near plane NP to far plane FP=((KS/(KS 8 tan 30 degree))*tan 15degree

In order to understand the meaning of TR, point on the linear imagecapture line of the lens plane that the 15 degree line hits/touches theComfort (CoC). The images are arranged so the key subject KS point isthe same in all images captured via plurality of images from imagecapture devices, such as digital image capture devices 831-833, ordigital image capture devices 831-834.

A user of image capture devices, such as digital image capture devices831-833, or digital image capture devices 831-834 composes the scene Sand moves the digital image capture devices 830 in our case so thecircle of confusion conveys the scene S. Since digital image capturedevices 830 are using multi cameras linearly spaced there is a binoculardisparity between the plurality of images or frames captured by linearoffset of digital image capture devices 830, such as digital imagecapture devices 831-833, or digital image capture devices 831-834. Thisdisparity can be change by changing digital image capture devices 830settings or moving the key subject KS back or away from digital imagecapture devices to lessen the disparity or moving the key subject KScloser to digital image capture devices to increase the disparity. Oursystem is a fixed digital image capture devices system and as aguideline, experimentally developed, the near plane NP should be nocloser than approximately six feet from digital image capture devices830.

Referring now to FIG. 12 , there is illustrated process steps as a flowdiagram 1200 of a method of capturing plurality of 2D image(s) of sceneS, generating frames 1101-1104, manipulating, reconfiguring, processing,displaying, storing a digital multi-dimensional image sequence asperformed by a computer system 10, and viewable on display 628. Note inFIG. 12 some steps designate a manual mode of operation may be performedby a user U, whereby the user is making selections and providing inputto computer system 10 in the step whereas otherwise operation ofcomputer system 10 is based on the steps performed by applicationprogram(s) 624 in an automatic mode.

In block or step 1210, providing computer system 10 having digital imagecapture devices 830, display 628, and applications 624 as describedabove in FIGS. 1-11 , to enable capture of a plurality of 2-dimensional(2D) images with a disparity due to spacing of digital image capturedevices 831-834, digital image capture devices 831-834, or the likewithin approximately an intraocular or interpupillary distance widthIPD, the distance between an average human's pupil, and displaying3-dimensional (3D) image sequence on display 628. Moreover, thesequential display of digital image(s) on display 628 (DIFY or stereo3D) where images(n) of the plurality of 2D image(s) of scene S capturedby capture devices 831-834 (n devices) are displayed in a sequentialorder on display 628 as a digital multi-dimensional image sequence (DIFYor stereo 3D).

In block or step 1215, computer system 10 via image capture application624 (method of capture) is configured to capture a plurality digitalimages of scene S via image capture module 830 having a plurality ofimage capture devices, such as digital image capture devices 831-834,830 (n devices)., or the like positioned in series linearly within anintraocular or interpupillary distance width IPD (distance betweenpupils of human visual system within a Circle of Comfort relationship tooptimize digital multi-dimensional images for the human visual system)capture a plurality of 2D digital source images. Computer system 10integrating I/O devices 632 with computer system 10, I/O devices 632 mayinclude one or more sensors 840 in communication with computer system 10to measure distance between computer system 10 (image capture devices,such as digital image capture devices 831-834, 830 (n devices)) andselected depths in scene S (depth) such as Key Subject KS and set thefocal point of one or more digital image capture devices 831-834, 830 (ndevices).

3D Stereo, user U may tap or other identification interaction withselection box 812 to select or identify key subject KS in the sourceimages, left image 1102 and right image 1103 of scene S, as shown inFIG. 16 . Additionally, in block or step 1215, utilizing computer system10, display 628, and application program(s) 206 (via image captureapplication) settings to align(ing) or position(ing) an icon, such ascross hair 814, of FIG. 16B, on key subject KS of a scene S displayedthereon display 628, for example by touching or dragging image of sceneS or pointing computer system 10 in a different direction to align crosshair 814, of FIG. 16 , on key subject KS of a scene S. In block or step1215, using, obtaining or capturing images(n) of scene S) focused onselected depths in an image or scene (depth) of scene S.

Alternatively, computer system 10 via image manipulation application 624and display 628 may be configured to operate in auto mode wherein one ormore sensors 840 may measure the distance between computer system 10(image capture devices, such as, digital image capture devices 831-834,830 (n devices)) and selected depths in scene S (depth) such as KeySubject KS. Alternatively, in manual mode, a user may determine thecorrect distance between computer system 10 and selected depths in sceneS (depth) such as Key Subject KS.

It is recognized herein that user U may be instructed on best practicesfor capturing images(n) of scene S via computer system 10 via imagecapture application 624 and display 628, such as frame the scene S toinclude the key subject KS in scene S, selection of the prominentforeground feature of scene S, and furthest point FP in scene S, mayinclude identifying key subject(s) KS in scene S, selection of closestpoint CP in scene S, the prominent background feature of scene S and thelike. Moreover, position key subject(s) KS in scene S a specifieddistance from digital image capture devices 831-834 (n devices), 830 (ndevices). Furthermore, position closest point CP in scene S a specifieddistance from digital image capture devices 831-834 (n devices).

Referring now to FIG. 13 , there is illustrated by way of example, andnot limitation, touch screen display 628 enabling user U to selectphotography options of computer system 10. A first exemplary option maybe DIFY capture wherein user U may specify or select digital image(s)speed setting 1302 where user U may increase or decrease play back speedor frames (images) per second of the sequential display of digitalimage(s) on display 628 captured by capture devices 831-834 (n devices).Furthermore, user U may specify or select digital image(s) number ofloops or repeats 1304 to set the number of loops of images(n) of theplurality of 2D image(s) 1000 of scene S captured by capture devices831-834 (n devices), 830 (n devices) where images(n) of the plurality of2D image(s) 1000 of scene S captured by capture devices 831-834 (ndevices) are displayed in a sequential order on display 628, similar toFIG. 11 . Still furthermore, user U may specify or select order ofplayback of digital image(s) sequences for playback or palindromesequence 1306 to set the order of display of images(n) of the pluralityof 2D image(s) 1000 of scene S captured by capture devices 831-834 (ndevices), 830 (n devices). The timed sequence showing of the imagesproduces the appropriate binocular disparity through the motion pursuitratio effect. It is contemplated herein that computer system 10 andapplication program(s) 624 may utilize default or automatic settingherein.

Referring now to FIG. 16B, there is illustrated by way of example, andnot limitation, touch screen display 628 enabling user U to selectphotography options of computer system 10 (3D Stereo). In block or step1215, utilizing computer system 10, display 628, and applicationprogram(s) 624 (via image capture application) settings to align(ing) orposition(ing) an icon, such as cross hair 1310 on key subject KS of ascene S displayed thereon display 628, for example by touching ordragging image of scene S or pointing computer system 10 in a differentdirection to align cross hair 1310, on key subject KS of a scene S. Inblock or step 1215, obtaining or capturing images(n) of scene S fromimage capture devices 831-834 (n devices) focused on selected depths inan image or scene (depth) of scene S. User U may tap or otheridentification interaction with selection box 1312 to select or identifykey subject KS in the source images, left image 1102L and right image1103R of scene S, selected from images(n) 1101, 1102, 1103, 1104 (set offrames 1100) of scene S from image capture devices 831-834 (n devices),or any combination of two images from images(n) 1101, 1102, 1103, 1104(set of frames 1100) . Moreover, computer system 10 via imagemanipulation application and display 624 may be configured to enableuser U to select or identify images of scene S as left image 1102 andright image 1103 of scene S. User U may tap or other identificationinteraction with selection box 812 to select or identify key subject KSin the source images, left image 1102 and right image 1103 of scene S,as shown in FIG. 16B.

Alternatively, in block or step 1215, user U may utilize computer system10, display 628, and application program(s) 624 to input plurality ofimages, files, and dataset (Dataset) of scene S, such as via AirDrop,DROP BOX, or other application.

It is recognized herein that step 1215, computer system 10 via imagecapture application 624, image manipulation application 624, imagedisplay application 624 may be performed utilizing distinct andseparately located computer systems 10, such as one or more user systems720 first smart device, 722 second smart device, 724 smart device (smartdevices) and application program(s) 624. For example, using a camerasystem remote from image manipulation system, and remote from imageviewing system, step 1215 may be performed proximate scene S viacomputer system 10 (first processor) and application program(s) 624communicating between user systems 720, 722, 724 and applicationprogram(s) 624. Here, camera system may be positioned or stationed tocapture segments of different viewpoints of an event or entertainment,such as scene S. Next, via communications link 740 and/or network 750,or 5G computer systems 10 and application program(s) 624 via more usersystems 720, 722, 724 may capture and transmit a plurality of digitalimages of scene S as digital multi-dimensional image sequence (DIFY) ofscene S sets of images(n) of scene S from capture devices 831-834 (ndevices) relative to key subject KS point.

Images captured at or near interpupillary distance IPD matches the humanvisual system, which simplifies the math, minimizes cross talk betweenthe two images, reduces fuzziness and image movement to produce digitalmulti-dimensional image sequence (DIFY) viewable on display 628.

Additionally, in block or step 1215, utilizing computer system 10,display 628, and application program(s) 624 (via dataset captureapplication) settings to align(ing) or position(ing) an icon, such ascross hair 1310, of FIG. 13 or 16B, on key subject KS of a scene Sdisplayed thereon display 628, for example by touching or draggingdataset of scene S, or touching and dragging key subject KS, or pointingcomputer system 10 in a different direction to align cross hair 1310, ofFIG. 13 , or 16B, on key subject KS of a scene S. In block or step 1215,obtaining or capturing plurality images, files, and dataset (Dataset) ofscene S from plurality of capture device(s) 830 (n devices) focused onselected depths in an image or scene (depth) of scene S.

Moreover, in block or step 1215, integrating I/O devices 632 withcomputer system 10, I/O devices 632 may include one or more sensors 852in communication with computer system 10 to measure distance betweencomputer system 10/capture device(s) 830 (n devices) and selected depthsin scene S (depth) such as Key Subject KS and set the focal point of anarc or trajectory of vehicle 400 and capture device(s) 830. It iscontemplated herein that computer system 10, display 628, andapplication program(s) 624, may operate in auto mode wherein one or moresensors 840 may measure the distance between capture device(s) 830 andselected depths in scene S (depth) such as Key Subject KS.Alternatively, in manual mode, a user may determine the correct distancebetween user U and selected depths in scene S (depth) such as KeySubject KS. Or computer system 10, display 628 may utilize one or moresensors 852 to measure distance between capture device(s) 830 (ndevices) and selected depths in scene S (depth) such as Key Subject KSand provide on screen instructions or message (distance preference) toinstruct user U to move capture device(s) 830 (n devices) closer orfather away from Key Subject KS or near plane NP to optimize capturedevice(s) 830 (n devices) and images, files, and dataset (Dataset) ofscene S.

In block or step 1220, computer system 10 via image manipulationapplication 624 is configured to receive a plurality of images of sceneS captured by digital image capture devices 831-834 (n devices), 830 (ndevices) through an image acquisition application. The image acquisitionapplication converts each image to a digital source image, such as aJPEG, GIF, TIF format. Ideally, each digital source image includes anumber of visible objects, subjects or points therein, such asforeground or closest point associated with near plane NP, far plane FPor furthest point associated with a far plane FP, and key subject KS.The near plane NP, far plane FP point are the closest point and furthestpoint from the viewer (plurality of capture devices 831 and 832, 833, or834, 830 (n devices)), respectively. The depth of field is the depth ordistance created within the object field (depicted distance betweenforeground to background). The principal axis is the line perpendicularto the scene passing through the key subject KS point, while theparallax is the displacement of the key subject KS point from theprincipal axis, see FIG. 11 . In digital composition the displacement isalways maintained as a whole integer number of pixels from the principalaxis.

It is recognized herein that step 1220, computer system 10 via imagecapture application 624, image manipulation application 624, imagedisplay application 624 may be performed utilizing distinct andseparately located computer systems 10, such as one or more user systems720, 722, 724 and application program(s) 624. For example, using animage manipulation system remote from image capture system, and remotefrom image viewing system, step 1220 may be performed remote from sceneS via computer system 10 (third processor) and application program(s)624 communicating between user systems 720, 222, 224 and applicationprogram(s) 624. Next, via communications link 740 and/or network 750, or5G computer systems 10 (third processor) and application program(s) 624via more user systems 720, 722, 724 may receive sets of plurality ofimages(n) of scene S from capture devices 831-834 (n devices) relativeto key subject KS point and transmit a manipulated plurality of digitalmulti-dimensional image sequence (DIFY or 3D stereo) of scene tocomputer system 10 (first processor) and application program(s) 624,step 1220A.

In block or step 1220A, computer system 10 via automatic key subjectselection algorithm or key subject application program(s) 624 isconfigured to identify a key subject KS in each source image, pluralityof images of scene S captured by digital image capture devices 831-834(n devices). Moreover, computer system 10 via key subject, applicationprogram(s) 624 is configured to identify (ing) at least in part a pixel,set of pixels (finger point selection on display 628) in one or moreplurality of images(n) of scene S from digital image capture devices831-834 (n devices) as key subject KS, respectively. Moreover, computersystem 10 via key subject application program(s) 624 is configured toalign source image, plurality of images of scene S captured by digitalimage capture devices 831-834 (n devices) horizontally about key subjectKS; (horizontal image translation (HIT) as shown in 11A and 11B with adistance key Subject KS within a Circle of Comfort relationship tooptimize digital multi-dimensional image sequence 1010 for the humanvisual system.

Moreover, a key subject point is identified in the series of 2D imagesof the scene S, and each of the series of 2D images of the scene isaligned to key subject KS point, and all other points in the series of2D images of the scene shift based on a spacing of the plurality ofdigital image capture devices to generate a modified sequence of 2Dimages.

Key subject KS may be identified in each plurality of images of scene Scaptured by digital image capture devices 831-834 (n devices)corresponds to the same key subject KS of scene S as shown in FIG. 11A,11B, and 4 . It is contemplated herein that a computer system 10,display 628, and application program(s) 624 may perform an algorithm orset of steps to automatically identify subject KS therein the pluralityof images of scene S captured by digital image capture devices 831-834(n devices). Alternatively, in block or step 1220A, utilizing computersystem 10, (in manual mode—manual key subject selection algorithm),display 628, and application program(s) 624 settings to at least in partenable a user U to align(ing) or edit alignment of a pixel, set ofpixels (finger point selection), key subject KS point of at least twoimages(n) of plurality of images of scene S captured by digital imagecapture devices 831-834 (n devices).

Source images, plurality of images of scene S captured by digital imagecapture devices 831-834 (n devices) of scene S are all obtained withdigital image capture devices 831-834 (n devices) with the same imagecapture distance and same focal length. Computer system 10 via keysubject application 624 creates a point of certainty, key subject KSpoint by performing a horizontal image shift of source images, pluralityof images of scene S captured by digital image capture devices 831-834(n devices), whereby source images, plurality of images of scene Scaptured by digital image capture devices 831-834 (n devices) overlap atthis one point, as shown in FIG. 13 . This image shift does two things,first it sets the depth of the image. All points in front of key subjectKS point are closer to the observer and all points behind key subject KSpoint are further from the observer.

Moreover, in an auto mode computer system 10 via image manipulationapplication may identify the key subject KS based on a depth map of thesource images, plurality of images of scene S captured by digital imagecapture devices 831-834 (n devices).

Computer system 10 via image manipulation application may identify aforeground, closest point and background, furthest point using a depthmap of the source images, plurality of images of scene S captured bydigital image capture devices 831-834 (n devices). Alternatively inmanual mode, computer system 10 via image manipulation application anddisplay 628 may be configured to enable user U to select or identify keysubject KS in the source images, plurality of images of scene S capturedby digital image capture devices 831-834 (n devices) of scene S. User Umay tap, move a cursor or box or other identification to select oridentify key subject KS in the source images, plurality of images ofscene S captured by digital image capture devices 831-834 (n devices) ofscene S, as shown in FIG. 13 .

Horizontal image translation (HIT) sets the key subject plane KSP as theplane of the screen from which the scene emanates (first or proximalplane). This step also sets the motion of objects, such as bush B innear plane NP (third or near plane) and tree T in far plane FP (secondor distal plane) relative to one another. Objects in front of keysubject KS or key subject plane KSP move in one direction (left to rightor right to left) while objects behind key subject KS or key subjectplane KSP move in the opposite direction from objects in the front.Objects behind the key subject plane KSP will have less parallax for agiven motion.

In the example of FIGS. 11, 11A and 11B, each layer 1100 includes theprimary image element of input file images of scene S, such as image orframe 1101, 1102, 1103 and 1104 from digital image capture devices831-834 (n devices), respectively. Image acquisition application 624,performs a process to translate image or frame 1101, 1102, 1103 and 1104image or frame 1101, 1102, 1103 and 1104 is overlapping and offset fromthe principal axis 1112 by a calculated parallax value, (horizontalimage translation (HIT). Parallax line 1107 represents the lineardisplacement of key subject KS points 1109.1-1109.4 from the principalaxis 1112. Preferably delta 1120 between the parallax line 1107represents a linear amount of the parallax 1120, such as front parallax1120.2 and back parallax 1120.1.

Calculate parallax, minimum parallax and maximum parallax as a functionof number of pixel, pixel density and number of frames, and closest andfurthest points, and other parameters as set U.S. Pat. Nos. 9,992,473,10,033,990, and 10,178,247, incorporated herein by reference in theirentirety.

In block or step 1220B, computer system 10 via depth map applicationprogram(s) 624 is configured to create(ing) depth map of source images,plurality of images of scene S captured by digital image capture devices831-834 (n devices) and makes a grey scale image through an algorithm. Adepth map is an image or image channel that contains informationrelating to the distance of objects, surfaces, or points in scene S froma viewpoint, such as digital image capture devices 831-834 (n devices).For example, this provides more information as volume, texture andlighting are more fully defined. Once a depth map 1220B is generatedthen the parallax can be tightly controlled. For this computer system 10may limit the number of output frames to four without going to a depthmap. If we use four from a depth map or two from a depth map, we are notlimited by the intermediate camera positions. Note the outer digitalimage capture devices 831 and 834 are locked into the interpupillarydistance (IPD) of the observer or user U viewing display 628.

Moreover, computer system 10 via key subject, application program(s) 624may identify key subject KS based on the depth map of the source images.Similarly, computer system 10 via depth map application program(s) 624may identify Near Plane NP may be the plane passing through the closestpoint in focus to the lens plane (the bush B in the foreground), FarPlane FP which is the plane passing through the furthest point in focus(tree T in the background) a foreground, closest point and background,furthest point using a depth map of the source image.

Computer system 10 via depth map application program(s) 624 may definetwo or more planes for each of series of 2D images of the scene and oneor more planes may have different depth estimate. Computer system 10 viadepth map application program(s) 624 may identify a first proximalplane, such as key subject plane KSP and a second distal plane withinthe series of 2D images of the scene, such as Near Plane NP or Far PlaneFP.

In block or step 1220C, computer system 10 via interlay(ing) applicationprogram(s) 624 is configured overlay 2D RGB high resolution digitalcamera thereon model or mesh of images(n) 1101, 1102, 1103, 1104 (set offrames 1100) of scene S with RGB high resolution color (DIFY or 3Dstereo).

In block or step 1220D, computer system 10 via dataset manipulationapplication 624 may be utilized to generate a model or mesh of scene Sfrom images(n) 1101, 1102, 1103, 1104 (set of frames 1100) of scene S.

In block or step 1225, computer system 10 via frame establishmentprogram(s) 624 is configured to create or generate frames, recording ofimages of images(n) 1101, 1102, 1103, 1104 (set of frames 1100) of sceneS from a virtual camera shifting, rotation, or arcing position, such assuch as 0.5 to 1 degree of separation or movement between frames, suchas −5, −4, −3, −2, −1, 0, 1, 2, 3, 4, 5; for DIFY represented 1101,1102, 1103, 1104 (set of frames 1100) of 3D color mesh Dataset of sceneS to generate parallax; for 3D Stereo as left and right; for example1102, 1103 images of 3D color mesh Dataset and 1101, 1102, 1103, 1104for (DIFY). Computer system 10 via key subject, application program(s)624 may establish increments, of shift for example one (1) degree oftotal shift between the views (typically 10-70 pixel shift on display628). This simply means a complete sensor (capture device) rotation of360 degrees around key subject KS would have 360 views so we are onlyusing/need view 1 and view 2, for 3D Stereo as left and right; 1102,1103 images Dataset. This gives us 1 degree of separation/disparity foreach view assuming rotational parallax orbiting around a key subject(zero parallax point). This will likely establish a minimumdisparity/parallax that can be adjusted up as the sensor (image capturemodule 830) moves farther away from key subject KS.

In block or step 1225A, computer system 10 via frame establishmentprogram(s) 624 is configured to input or upload source images capturedexternal from computer system 10.

In block or step 1230, utilizing computer system 10 via horizontal andvertical frame DIF translation application 624 may be configured tohorizontally and vertically align or transform each source image,plurality of images of scene S captured by digital image capture devices831-834 (n devices) requires a dimensional image format (DIF) transform.The DIF transform is a geometric shift that does not change theinformation acquired at each point in the source image, plurality ofimages of scene S captured by digital image capture devices 831-834 (ndevices) but can be viewed as a shift of all other points in the sourceimage, plurality of images of scene S captured by digital image capturedevices 831-834 (n devices), in Cartesian space (illustrated in FIG. 11). As a plenoptic function, the DIF transform is represented by theequation:

P′(u,v)×P′(θ,φ)=[P _(u,v)+Δ_(u,v) ]×[P _(θ,φ)+Δ_(θ,φ])

Where Δu,v=Δθ,ϕ

In the case of a digital image source, the geometric shift correspondsto a geometric shift of pixels which contain the plenoptic information,the DIF transform then becomes:

(Pixel)_(x,y)=(Pixel)_(x,y)+Δ_(x,y)

Moreover, computer system 10 via horizontal and vertical frame DIFtranslation application 624 may also apply a geometric shift to thebackground and or foreground using the DIF transform. The background andforeground may be geometrically shifted according to the depth of eachrelative to the depth of the key subject KS identified by the depth map1220B of the source image, plurality of images of scene S captured bydigital image capture devices 831-834 (n devices). Controlling thegeometrical shift of the background and foreground relative to the keysubject KS controls the motion parallax of the key subject KS. Asdescribed, the apparent relative motion of the key subject KS againstthe background or foreground provides the observer with hints about itsrelative distance. In this way, motion parallax is controlled to focusobjects at different depths in a displayed scene to match vergence andstereoscopic retinal disparity demands to better simulate naturalviewing conditions. By adjusting the focus of key subjects KS in a sceneto match their stereoscopic retinal disparity (an intraocular orinterpupillary distance width IPD (distance between pupils of humanvisual system), the cues to ocular accommodation and vergence arebrought into agreement.

Referring again to FIG. 4 , viewing a DIFY, multidimensional imagesequence 1010 on display 628 requires two different eye actions of userU. The first is the eyes will track the closest item, point, or object(near plane NP) in multidimensional image sequence 1010 on display 628,which will have linear translation back and forth to the stationary keysubject plane KSP due to image or frame 1101, 1102, 1103 and 1104 isoverlapping and offset from the principal axis 1112 by a calculatedparallax value, (horizontal image translation (HIT)). This trackingoccurs through the eyeball moving to follow the motion. Second, the eyeswill perceive depth due to the smooth motion change of any point orobject relative to the key subject plane KSP and more specifically tothe key subject KS point. Thus, DIFYs are composed of one mechanicalstep and two eye functions.

A mechanical step of translating of the frames so the Key Subject KSpoint overlaps on all frames. Linear translation back and forth to thestationary key subject plane KSP due to image or frame 1101, 1102, 1103and 1104 may be overlapping and offset from the principal axis 1112 by acalculated parallax value, (horizontal image translation (HIT). Eyefollowing motion of near plane NP object which exhibits greatestmovement relative to the key subject KS (Eye Rotation). Difference inframe position along the key subject plane KSP (Smooth Eye Motion) whichintroduces binocular disparity. Comparison of any two points other thankey subject KS also produces depth (binocular disparity). Points behindkey subject plane KSP move in opposite direction than those points infront of key subject KS. Comparison of two points in front or back oracross key subject KS plane shows depth.

In block or step 1235A, computer system 10 via palindrome application626 is configured to create, generate, or produce multidimensionaldigital image sequence 1010 aligning sequentially each image ofimages(n) of scene S from digital image capture devices 831-834 (ndevices) in a seamless palindrome loop (align sequentially), such asdisplay in sequence a loop of first digital image, image or frame 1101from first digital image capture device 831 (1), second digital image,image or frame 1102 from second digital image capture device 832 (2),capture device 832, third digital image, image or frame 1103 from thirddigital image capture device 833 (3), fourth digital image, image orframe 1104 from fourth digital image capture device 834 (4). Moreover,an alternate sequence a loop of first digital image, image or frame 1101from first digital image capture device 831 (1), second digital image,image or frame 1102 from second digital image capture device 832 (2),capture device 832, third digital image, image or frame 1103 from thirddigital image capture device 833 (3), fourth digital image, image orframe 1104 from fourth digital image capture device 834 (4), fourthdigital image, image or frame 1104 from fourth digital image capturedevice 834 (4), third digital image, image or frame 1103 from thirddigital image capture device 833 (3), second digital image, image orframe 1102 from second digital image capture device 832 (2), of firstdigital image, image or frame 1101 from first digital image capturedevice 831 (1) −1, 2, 3, 4, 4, 3, 2, 1 (align sequentially). Preferredsequence is to follow the same sequence or order in which images werecaptured source image, plurality of images of scene S captured bydigital image capture devices 831-834 (n devices) and an inverted orreverse sequence is added to create a seamless palindrome loop.

It is contemplated herein that other sequences may be configured herein,including but not limited to 1, 2, 3, 4, 3, 2, 1 (align sequentially)and the like.

It is contemplated herein that horizontally and vertically align(ing) offirst proximal plane, such as key subject plane KSP of each image ofimages(n) of scene S from digital image capture devices 831-834 (ndevices) and shifting second distal plane, such as such as foregroundplane, Near Plane NP, or background plane, Far Plane FP of eachsubsequent image frame in the sequence based on the depth estimate ofthe second distal plane for series of 2D images of the scene to producesecond modified sequence of 2D images.

In block or step 1235B, computer system 10 via interphasing application626 may be configured to interphase columns of pixels of each set offrames 1100, specifically as left image 1102 and right image 1103 togenerate a multidimensional digital image aligned to the key subject KSpoint and within a calculated parallax range. As shown in FIG. 16A,interphasing application 626 may be configured to takes sections,strips, rows, or columns of pixels from left image 1102 and right image1103, such as column 1602A of the source images, left image 1102, andright image 1103 of terrain T of scene S and layer them alternatingbetween column 1602A of left image 1102-LE, and column 1602A of rightimage 1103-RE and reconfigures or lays them out in series side-by-sideinterlaced, such as in repeating series 160A two columns wide, andrepeats this configuration for all layers of the source images, leftimage 1102 and right image 1103 of terrain T of scene S to generatemultidimensional image 1010 with column 1602A dimensioned to be onepixel 1550 wide.

It is contemplated herein that source images, plurality of images ofscene S captured by capture device(s) 830 match size and configurationof display 628 aligned to the key subject KS point and within acalculated parallax range.

Now given the multidimensional image sequence 1010, we move to observethe viewing side of the device.

It is contemplated herein that source images, plurality of images ofscene S captured by digital image capture devices 831-834 (n devices)match size and configuration of display 628 aligned to the key subjectKS point and within a calculated parallax range.

In block or step 1240, computer system 10 via image editing application624 is configured to crop, zoom, align, enhance, or perform editsthereto each image(n) of scene S from capture devices 831-834 (ndevices) or edit multidimensional digital image sequence 1010.

Moreover, computer system 10 and editing application program(s) 624 mayenable user U to perform frame enhancement, layer enrichment, animation,feathering (smooth), (Photoshop or Acorn photo or image tools), tosmooth or fill in the images (n) together, or other software techniquesfor producing 3D effects on display 628. It is contemplated herein thata computer system 10 (auto mode), display 628, and applicationprogram(s) 624 may perform an algorithm or set of steps to automaticallyor enable automatic performance of align(ing) or edit(ing) alignment ofa pixel, set of pixels of key subject KS point, crop, zoom, align,enhance, or perform edits of the plurality of images of scene S capturedby digital image capture devices 831-834 (n devices) or editmultidimensional digital image sequence 1010.

Alternatively, in block or step 1240, utilizing computer system 10, (inmanual mode), display 628, and application program(s) 624 settings to atleast in part enable a user U to align(ing) or edit(ing) alignment of apixel, set of pixels of key subject KS point, crop, zoom, align,enhance, or perform edits of the plurality of images of scene S capturedby digital image capture devices 831-834 (n devices) or editmultidimensional digital image sequence 1010.

Furthermore, user U via display 628 and editing application program(s)624 may set or chose the speed (time of view) for each frame and thenumber of view cycles or cycle forever as shown in FIG. 13 . Timeinterval may be assigned to each frame in multidimensional digital imagesequence 1010. Additionally, the time interval between frames may beadjusted at step 1240 to provide smooth motion and optimal 3D viewing ofmultidimensional digital image sequence 1010.

It is contemplated herein that a computer system 10, display 628, andapplication program(s) 624 may perform an algorithm or set of steps toautomatically or manually edit or apply effects to set of frames 1100.Moreover, computer system 10 and editing application program(s) 206 mayinclude edits, such as frame enhancement, layer enrichment, feathering,(Photoshop or Acorn photo or image tools), to smooth or fill in theimages (n) together, and other software techniques for producing 3Deffects to display 3-D multidimensional image of terrain T of scene Sthereon display 628.

In block or step 1250, computer system 10 via image display application624 is configured to enable images(n) of scene S to display, viasequential palindrome loop, multidimensional digital image sequence 1010of scene S on display 628 for different dimensions of displays 628.Again, multidimensional digital image sequence 1010 of scene S,resultant 3D image sequence, may be output as a DIF sequence to display628. It is contemplated herein that computer system 10, display 628, andapplication program(s) 624 may be responsive in that computer system 10may execute an instruction to size each image (n) of scene S to fit thedimensions of a given display 628.

Moreover, user U may elect to return to block or step 1220 to choose anew key subject KS in each source image, plurality of images of scene Scaptured by digital image capture devices 831-834 (n devices) andprogress through steps 1220-1250 to view on display 628, via creation ofa new or second sequential loop, multidimensional digital image sequence1010 of scene S for new key subject KS.

Now given the multidimensional image sequence 1010, we move to observethe viewing side of the device. Moreover, in block or step 735, computersystem 10 via output application 730 (206) may be configured to displaymultidimensional image(s) 1010 on display 628 for one more user systems220, 222, 224 via communications link 240 and/or network 250, or 5Gcomputer systems 10 and application program(s) 206.

For 3D Stereo, referring now to FIG. 15A, there is illustrated by way ofexample, and not limitation a cross-sectional view of an exemplary stackup of components of display 628. Display 628 may include an array of orplurality of pixels emitting light, such as LCD panel stack ofcomponents 1520 having electrodes, such as front electrodes and backelectrodes, polarizers, such as horizontal polarizer and verticalpolarizer, diffusers, such as gray diffuser, white diffuser, andbacklight to emit red R, green G, and blue B light. Moreover, display628 may include other standard LCD user U interaction components, suchas top glass cover 1510 with capacitive touch screen glass 1512positioned between top glass cover 1510 and LCD panel stack components1520. It is contemplated herein that other forms of display 628 may beincluded herein other than LCD, such LED, ELED, PDP, QLED, and othertypes of display technologies. Furthermore, display 628 may include alens array, such as lenticular lens 1514 preferably positioned betweencapacitive touch screen glass 1512 and LCD panel stack of components1520, and configured to bend or refract light in a manner capable ofdisplaying an interlaced stereo pair of left and right images as a 3D ormultidimensional digital image(s) 1010 on display 628 and, therebydisplaying a multidimensional digital image of scene S on display 628.Transparent adhesives 1530 may be utilized to bond elements in thestack, whether used as a horizontal adhesive or a vertical adhesive tohold multiple elements in the stack. For example, to produce a 3D viewor produce a multidimensional digital image on display 628, a 1920×1200pixel image via a plurality of pixels needs to be divided in half,960×1200, and either half of the plurality of pixels may be utilized fora left image and right image.

It is contemplated herein that lens array may include other techniquesto bend or refract light, such as barrier screen (black line),lenticular, parabolic, overlays, waveguides, black line and the likecapable of separate into a left and right image.

It is further contemplated herein that lenticular lens 514 may beorientated in vertical columns when display 628 is held in a landscapeview to produce a multidimensional digital image on display 628.However, when display 628 is held in a portrait view the 3D effect isunnoticeable enabling 2D and 3D viewing with the same display 628.

It is still further contemplated herein that smoothing, or other imagenoise reduction techniques, and foreground subject focus may be used tosoften and enhance the 3D view or multidimensional digital image ondisplay 628.

Referring now to FIG. 15B, there is illustrated by way of example, andnot limitation a representative segment or section of one embodiment ofexemplary refractive element, such as lenticular lens 1514 of display628. Each sub-element of lenticular lens 1514 being arced or curved orarched segment or section 1540 (shaped as an arc) of lenticular lens1514 may be configured having a repeating series of trapezoidal lenssegments or plurality of sub-elements or refractive elements. Forexample, each arced or curved or arched segment 1540 may be configuredhaving lens peak 1541 of lenticular lens 1540 and dimensioned to be onepixel 1550 (emitting red R, green G, and blue B light) wide such ashaving assigned center pixel 1550C thereto lens peak 1541. It iscontemplated herein that center pixel 1550C light passes throughlenticular lens 1540 as center light 1560C to provide 2D viewing ofimage on display 628 to left eye LE and right eye RE a viewing distanceVD from pixel 1550 or trapezoidal segment or section 1540 of lenticularlens 1514. Moreover, each arced or curved segment 1540 may be configuredhaving angled sections, such as lens angle A1 of lens refractiveelement, such as lens sub-element 1542 (plurality of sub-elements) oflenticular lens 1540 and dimensioned to be one pixel wide, such ashaving left pixel 1550L and right pixel 1550R assigned thereto leftlens, left lens sub-element 1542L having angle A1, and right lenssub-element 1542R having angle A1, for example an incline angle and adecline angle respectively to refract light across center line CL. It iscontemplated herein that pixel 1550L/R light passes through lenticularlens 1540 and bends or refracts to provide left and right images toenable 3D viewing of image on display 628; via left pixel 1550L lightpasses through left lens angle 1542L and bends or refracts, such aslight entering left lens angle 1542L bends or refracts to cross centerline CL to the right R side, left image light 1560L toward left eye LEand right pixel 1550R light passes through right lens angle 1542R andbends or refracts, such as light entering right lens angle 1542R bendsor refracts to cross center line CL to the left side L, right imagelight 1560R toward right eye RE, to produce a multidimensional digitalimage on display 628.

It is contemplated herein that left and right images may be produce asset forth in FIGS. 6.1-6.3 from U.S. Pat. No. 9,992,473, 10,033,990, and10,178,247 and electrically communicated to left pixel 550L and rightpixel 550R. Moreover, 2D image may be electrically communicated tocenter pixel 550C.

In this figure each lens peak 1541 has a corresponding left and rightangled lens 1542, such as left angled lens 1542L and right angled lens1542R on either side of lens peak 1541 and each assigned one pixel,center pixel 1550C, left pixel 1550L and right pixel 1550R, assignedrespectively thereto.

In this figure the viewing angle A1 is a function of viewing distanceVD, size S of display 628, wherein A1=2 arctan (S/2VD)

In one embodiment, each pixel may be configured from a set ofsub-pixels. For example, to produce a multidimensional digital image ondisplay 628 each pixel may be configured as one or two 3×3 sub-pixels ofLCD panel stack components 1520 emitting one or two red R light, one ortwo green G light, and one or two blue B light therethrough segments orsections of lenticular lens 1540 to produce a multidimensional digitalimage on display 628. Red R light, green G light, and blue B may beconfigured as vertical stacks of three horizontal sub-pixels.

It is recognized herein that trapezoid shaped lens 1540 bends orrefracts light uniformly through its center C, left L side, and right Rside, such as left angled lens 1542L and right angled lens 1542R, andlens peak 1541.

Referring now to FIG. 15C, there is illustrated by way of example, andnot limitation a prototype segment or section of one embodiment ofexemplary lenticular lens 1514 of display 628. Each segment or pluralityof sub-elements or refractive elements being trapezoidal shaped segmentor section 1540 of lenticular lens 1514 may be configured having arepeating series of trapezoidal lens segments. For example, eachtrapezoidal segment 1540 may be configured having lens peak 1541 oflenticular lens 1540 and dimensioned to be one or two pixel 1550 wideand flat or straight lens, such as lens valley 1543 and dimensioned tobe one or two pixel 1550 wide (emitting red R, green G, and blue Blight). For example, lens valley 1543 may be assigned center pixel1550C. It is contemplated herein that center pixel 1550C light passesthrough lenticular lens 1540 as center light 1560C to provide 2D viewingof image on display 628 to left eye LE and right eye RE a viewingdistance VD from pixel 1550 or trapezoidal segment or section 1540 oflenticular lens 1514. Moreover, each trapezoidal segment 1540 may beconfigured having angled sections, such as lens angle 1542 of lenticularlens 1540 and dimensioned to be one or two pixel wide, such as havingleft pixel 1550L and right pixel 1550R assigned thereto left lens angle1542L and right lens angle 1542R, respectively. It is contemplatedherein that pixel 1550L/R light passes through lenticular lens 1540 andbends to provide left and right images to enable 3D viewing of image ondisplay 628; via left pixel 1550L light passes through left lens angle1542L and bends or refracts, such as light entering left lens angle1542L bends or refracts to cross center line CL to the right R side,left image light 1560L toward left eye LE; and right pixel 1550R lightpasses through right lens angle 1542R and bends or refracts, such aslight entering right lens angle 1542R bends or refracts to cross centerline CL to the left side L, right image light 1560R toward right eye REto produce a multidimensional digital image on display 628.

It is contemplated herein that angle A1 of lens angle 1542 is a functionof the pixel 1550 size, stack up of components of display 628,refractive properties of lenticular lens 514, and distance left eye LEand right eye RE are from pixel 1550, viewing distance VD.

In this FIG. 15C, the viewing angle A1 is a function of viewing distanceVD, size S of display 628, wherein A1=2 arctan (S/2VD).

Referring now to FIG. 15D, there is illustrated by way of example, andnot limitation a representative segment or section of one embodiment ofexemplary lenticular lens 1514 of display 628. Each segment or pluralityof sub-elements or refractive elements being parabolic or dome shapedsegment or section 1540A (parabolic lens or dome lens, shaped a dome) oflenticular lens 1514 may be configured having a repeating series of domeshaped, curved, semi-circular lens segments. For example, each domesegment 1540A may be configured having lens peak 1541 of lenticular lens1540 and dimensioned to be one or two pixel 1550 wide (emitting red R,green G, and blue B light) such as having assigned center pixel 1550Cthereto lens peak 1541. It is contemplated herein that center pixel1550C light passes through lenticular lens 540 as center light 560C toprovide 2D viewing of image on display 628 to left eye LE and right eyeRE a viewing distance VD from pixel 1550 or trapezoidal segment orsection 1540 of lenticular lens 1514. Moreover, each trapezoidal segment1540 may be configured having angled sections, such as lens angle 1542of lenticular lens 1540 and dimensioned to be one pixel wide, such ashaving left pixel 1550L and right pixel 1550R assigned thereto left lensangle 1542L and right lens angle 1542R, respectively. It is contemplatedherein that pixel 1550L/R light passes through lenticular lens 1540 andbends to provide left and right images to enable 3D viewing of image ondisplay 628; via left pixel 1550L light passes through left lens angle1542L and bends or refracts, such as light entering left lens angle1542L bends or refracts to cross center line CL to the right R side,left image light 1560L toward left eye LE and right pixel 1550R lightpasses through right lens angle 1542R and bends or refracts, such aslight entering right lens angle 1542R bends or refracts to cross centerline CL to the left side L, right image light 1560R toward right eye REto produce a multidimensional digital image on display 628.

It is recognized herein that dome shaped lens 1540B bends or refractslight almost uniformly through its center C, left L side, and right Rside.

It is recognized herein that representative segment or section of oneembodiment of exemplary lenticular lens 1514 may be configured in avariety of other shapes and dimensions.

Moreover, to achieve highest quality two dimensional (2D) image viewingand multidimensional digital image viewing on the same display 628simultaneously, a digital form of alternating black line or parallaxbarrier (alternating) may be utilized during multidimensional digitalimage viewing on display 628 without the addition of lenticular lens1514 to the stack of display 628 and then digital form of digital formof alternating black line or parallax barrier (alternating) may bedisabled during two dimensional (2D) image viewing on display 628.

A parallax barrier is a device placed in front of an image source, suchas a liquid crystal display, to allow it to show a stereoscopic ormultiscopic image without the need for the viewer to wear 3D glasses.Placed in front of the normal LCD, it consists of an opaque layer with aseries of precisely spaced slits, allowing each eye to see a differentset of pixels, so creating a sense of depth through parallax. A digitalparallax barrier is a series of alternating black lines in front of animage source, such as a liquid crystal display (pixels), to allow it toshow a stereoscopic or multiscopic image. In addition, face-trackingsoftware functionality may be utilized to adjust the relative positionsof the pixels and barrier slits according to the location of the user'seyes, allowing the user to experience the 3D from a wide range ofpositions. The book Design and Implementation of AutostereoscopicDisplays by Keehoon Hong, Soon-gi Park, Jisoo Hong, Byoungho Leeincorporated herein by reference.

It is contemplated herein that parallax and key subject KS referencepoint calculations may be formulated for distance between virtual camerapositions, interphasing spacing, display 628 distance from user U,lenticular lens 1514 configuration (lens angle A1, 1542, lens permillimeter and millimeter depth of the array), lens angle 1542 as afunction of the stack up of components of display 628, refractiveproperties of lenticular lens 1514, and distance left eye LE and righteye RE are from pixel 1550, viewing distance VD, distance betweenvirtual camera positions (interpupillary distance IPD), and the like toproduce digital multi-dimensional images as related to the viewingdevices or other viewing functionality, such as barrier screen (blackline), lenticular, parabolic, overlays, waveguides, black line and thelike with an integrated LCD layer in an LED or OLED, LCD, OLED, andcombinations thereof or other viewing devices.

Incorporated herein by reference is paper entitled Three-DimensionalDisplay Technology, pages 1-80, by Jason Geng of other displaytechniques or the like that may be utilized to produce display 628,incorporated herein by reference.

It is contemplated herein that number of lenses per mm or inch oflenticular lens 514 is determined by the pixels per inch of display 628.

It is contemplated herein that other angles A1 are contemplated herein,distance of pixels 1550C, 1550L, 1550R from of lens 1540 (approximately0.5 mm), and user U viewing distance from smart device display 628 fromuser's eyes (approximately fifteen (15) inches), and average humaninterpupilary spacing between eyes (approximately 2.5 inches) may befactored or calculated to produce digital multi-dimensional images.Governing rules of angles and spacing assure the viewed images thereondisplay 628 is within the comfort zone of the viewing device to producedigital multi-dimensional images, see FIGS. 5, 6, 11 below.

It is recognized herein that angle A1 of lens 1541 may be calculated andset based on viewing distance VD between user U eyes, left eye LE andright eye RE, and pixels 550, such as pixels 1550C, 1550L, 1550R, acomfortable distance to hold display 628 from user's U eyes, such as ten(10) inches to arm/wrist length, or more preferably betweenapproximately fifteen (15) inches to twenty-four (24) inches, and mostpreferably at approximately fifteen (15) inches.

In use, the user U moves the display 628 toward and away from user'seyes until the digital multi-dimensional images appear to user, thismovement factor in user's U actual interpupilary distance IPD spacingand to match user's visual system (near sited and far siteddiscrepancies) as a function of width position of interlaced left andright images from distance between virtual camera positions(interpupilary distance IPD), key subject KS depth therein each ofdigital images(n) of scene S (key subject KS algorithm), horizontalimage translation algorithm of two images (left and right image) aboutkey subject KS, interphasing algorithm of two images (left and rightimage) about key subject KS, angles A1, distance of pixels 1550 from oflens 1540 (pixel-lens distance (PLD) approximately 0.5 mm)) andrefractive properties of lens array, such as trapezoid shaped lens 1540all factored in to produce digital multi-dimensional images for user Uviewing display 628. First known elements are number of pixels 1550 andnumber of images, two image, distance between virtual camera positions,or (interpupilary distance IPD). Images captured at or nearinterpupilary distance IPD matches the human visual system, simplifiesthe math, minimizes cross talk between the two images, fuzziness, imagemovement to produce digital multi-dimensional image viewable on display628.

It is further contemplated herein that trapezoid shaped lens 1540 may beformed from polystyrene, polycarbonate or other transparent materials orsimilar materials, as these material offers a variety of forms andshapes, may be manufactured into different shapes and sizes, and providestrength with reduced weight; however, other suitable materials or thelike, can be utilized, provided such material has transparency and ismachineable or formable as would meet the purpose described herein toproduce a left and right stereo image and specified index of refraction.It is further contemplated herein that trapezoid shaped lens 1541 may beconfigured with 4.5 lenticular lens per millimeter and approximately0.33 mm depth.

DIFY, in block or step 1250, computer system 10 via image displayapplication 624 is configured to set of frames 1100 of terrain T ofscene S to display, via sequential palindrome loop, multidimensionaldigital image sequence 1010 on display 628 for different dimensions ofdisplays 628. Again, multidimensional digital image sequence 1010 ofscene S, resultant 3D image sequence, may be output as a DIF sequence or.MPO file to display 628. It is contemplated herein that computer system10, display 628, and application program(s) 624 may be responsive inthat computer system 10 may execute an instruction to size each image(n) of scene S to fit the dimensions of a given display 628.

In block or step 1250, multidimensional image sequence 1010 on display628, utilizes a difference in position of objects in each of images(n)of scene S from set of frames 1100 relative to key subject plane KSP,which introduces a parallax disparity between images in the sequence todisplay multidimensional image sequence 1010 on display 628 to enableuser U, in block or step 1250 to view multidimensional image sequence1010 on display 628.

Moreover, in block or step 1250, computer system 10 via outputapplication 624 may be configured to display multidimensional imagesequence 1010 on display 628 for one more user system 720, 722, 724 viacommunications link 740 and/or network 750, or 5G computer systems 10and application program(s) 624.

3D Stereo, in block or step 1250, computer system 10 via outputapplication 624 may be configured to display multidimensional image 1010on display 628. Multidimensional image 1010 may be displayed via leftand right pixel 1102L/1103R light passes through lenticular lens 1540and bends or refracts to provide 3D viewing of multidimensional image1010 on display 628 to left eye LE and right eye RE a viewing distanceVD from pixel 1550.

In block or step 1250, utilizing computer system 10, display 628, andapplication program(s) 624 settings to configure each images(n) (L&Rsegments) of scene S from set of frames 1100 of terrain T of scene Ssimultaneously with Key Subject aligned between images for binoculardisparity for display/view/save multi-dimensional digital image(s) 1010on display 628, wherein a difference in position of each images(n) ofscene S from virtual cameras relative to key subject KS plane introducesa (left and right) binocular disparity to display a multidimensionaldigital image 1010 on display 628 to enable user U , in block or step1250 to view multidimensional digital image on display 628.

Moreover, user U may elect to return to block or step 1220 to choose anew key subject KS in each source image, set of frames 1100 of terrain Tof scene S and progress through steps 1220-1250 to view on display 628,via creation of a new or second sequential loop, multidimensionaldigital image sequence 1010 of scene S for new key subject KS.

Display 628 may include display device (e.g., viewing screen whetherimplemented on a smart phone, PDA, monitor, TV, tablet or other viewingdevice, capable of projecting information in a pixel format) or printer(e.g., consumer printer, store kiosk, special printer or other hard copydevice) to print multidimensional digital master image on, for example,lenticular or other physical viewing material.

It is recognized herein that steps 1220-1240, may be performed bycomputer system 10 via image manipulation application 626 utilizingdistinct and separately located computer systems 10, such as one or moreuser systems 720, 722, 724 and application program(s) 626 performingsteps herein. For example, using an image processing system remote fromimage capture system, and from image viewing system, steps 1220-1240 maybe performed remote from scene S via computer system 10 or server 760and application program(s) 624 and communicating between user systems720, 722, 724 and application program(s) 626 via communications link 740and/or network 750, or via wireless network, such as 5G, computersystems 10 and application program(s) 626 via more user systems 720,722, 724. Here, computer system 10 via image manipulation application624 may manipulate 24 settings to configure each images(n) (L&Rsegments) of scene S from of scene S from virtual camera to generatemultidimensional digital image sequence 1010 aligned to the key subjectKS point and transmit for display multidimensional digitalimage/sequence 1010 to one or more user systems 720, 722, 724 viacommunications link 740 and/or network 750, or via wireless network,such as 5G computer systems 10 or server 760 and application program(s)624.

Moreover, it is recognized herein that steps 1220-1240, may be performedby computer system 10 via image manipulation application 624 utilizingdistinct and separately located computer systems 10 positioned on thevehicle. For example, using an image processing system remote from imagecapture system, steps 1220-1240 via computer system 10 and applicationprogram(s) 624 computer systems 10 may manipulate 24 settings toconfigure each images(n) (L&R segments) of scene S from of scene S fromcapture device(s) 830 to generate a multidimensional digitalimage/sequence 1010 aligned to the key subject KS point. Here, computersystem 10 via image manipulation application 626 may utilizemultidimensional image/sequence 1010 to navigate the vehicle V throughterrain T of scene S. Alternatively, computer system 10 via imagemanipulation application 626 may enable user U remote from vehicle V toutilize multidimensional image/sequence 1010 to navigate the vehicle Vthrough terrain T of scene S.

It is contemplated herein that computer system 10 via output application624 may be configured to enable display of multidimensional imagesequence 1010 on display 628 to enable a plurality of user U, in blockor step 1250 to view multidimensional image sequence 1010 on display 628live or as a replay/rebroadcast.

It is recognized herein that step 1250, may be performed by computersystem 10 via output application 624 utilizing distinct and separatelylocated computer systems 10, such as one or more user systems 720, 722,724 and application program(s) 624 performing steps herein. For example,using an output or image viewing system, remote from scene S viacomputer system 10 and application program(s) 624 and communicatingbetween user systems 720, 722, 724 and application program(s) 626 viacommunications link 740 and/or network 750, or via wireless network,such as 5G, computer systems 10 and application program(s) 624 via moreuser systems 720, 722, 724. Here, computer system 10 output application624 may receive manipulated plurality of two digital images of scene Sand display multidimensional image/sequence 1010 to one more usersystems 720, 722, 724 via communications link 740 and/or network 750, orvia wireless network, such as 5G computer systems 10 and applicationprogram(s) 624.

Moreover, via communications link 740 and/or network 750, wireless, suchas 5G second computer system 10 and application program(s) 624 maytransmit sets of images(n) of scene S configured relative to key subjectplane KSP as multidimensional image sequence 1010 on display 628 toenable a plurality of user U, in block or step 1250 to viewmultidimensional image/sequence 1010 on display 628 live or as areplay/rebroadcast.

Referring now to FIG. 13 , there is illustrated by way of example, andnot limitation, touch screen display 628 enabling user U to selectphotography options of computer system 10. A first exemplary option maybe DIFY capture wherein user U may specify or select digital image(s)speed setting 1302 where user U may increase or decrease play back speedor frames (images) per second of the sequential display of digitalimage(s) on display 628 multidimensional image/sequence 1010.Furthermore, user U may specify or select digital image(s) number ofloops or repeats 1304 to set the number of loops of images(n) of theplurality of 2D image(s) 1000 of scene S where images(n) of theplurality of 2D image(s) 1000 of scene S are displayed in a sequentialorder on display 628, similar to FIG. 11 . Still furthermore, user U mayspecify or select order of playback of digital image(s) sequences forplayback or palindrome sequence 1306 to set the order of display ofimages(n) of the multidimensional image/sequence 1010 of scene S. Thetimed sequence showing of the images produces the appropriate binoculardisparity through the motion pursuit ratio effect. It is contemplatedherein that computer system 10 and application program(s) 624 mayutilize default or automatic setting herein.

DIFY, referring to FIGS. 14A and 14B, there is illustrated by way ofexample, and not limitation, frames captured in a set sequence which areplayed back to the eye in a set sequence and a representation of whatthe human eyes perceives viewing the DIFY on display 628. Explanation ofDIFY and its geometry to produce motion parallax. Motion parallax is thechange in angle of a point relative to a stationary point. (MotionPursuit). Note because we have set the key subject KS point all pointsin foreground will move to the right, while all points in the backgroundwill move to the left. The motion is reversed in a paledrone where theimages reverse direction. The angular change of any point in differentviews relative to the key subject creates motion parallax.

A DIFY is a series of frames captured in a set sequence which are playedback to the eye in the set sequence as a loop. For example, the playback of two frames (assume first and last frame, such as frame 1101 and1104) is depicted in FIG. 14A. FIG. 14A represents the position of anobject, such as a near plane NP object in FIG. 4 on the near plane NPand its relation to key subject KS point in frame 1101 and 1104 whereinkey subject KS point is constant due to the image translation imposed onthe frames, frame 1101, 1102, 1103 and 1104. Frames, frame 1101, 1102,1103 and 1104 in FIG. 11A and 11B may be overlapping and offset from theprincipal axis 1112 by a calculated parallax value, (horizontal imagetranslation (HIT) and preset by the spacing of virtual camera. FIG. 14Bthere is illustrated by way of example, and not limitation what thehuman eye perceives from the viewing of the two frames (assume first andlast frame, such as frame 1101 and 1104 having frame in near plane NP aspoint 1401 and frame 2 in near plane NP as point 1402) depicted in FIG.14A on display 628 where image plane or screen plane is the same as keysubject KS point and key subject plane KSP and user U viewing display628 views virtual depth near plane NP 1410 in front of display 628 orbetween display 628 and user U eyes, left eye LE and right eye RE.Virtual depth near plane NP 1410 is near plane NP as it represents frame1 in near plane NP as object in near plane point 1401 and frame 2 innear plane NP as object in near plane point 1402, the closest pointsuser U eyes, left eye LE and right eye RE see when viewingmultidimensional image sequence 1010 on display 628.

Virtual depth near plane NP 1410 simulates a visual depth between keysubject KS and object in near plane point 1401 and object in near planepoint 1402 as virtual depth 1420, depth between the near plane NP andkey subject plane KSP. This depth is due to binocular disparity betweenthe two views for the same point, object in near plane point 1401 andobject in near plane point 1402. Object in near plane point 1401 andobject in near plane point 1402 are preferably same point in scene S, atdifferent views sequenced in time due to binocular disparity. Moreover,outer rays 1430 and more specifically user U eyes, left eye LE and righteye RE viewing angle 1440 is preferably approximately twenty-seven (27)degrees from the retinal or eye axis. (Similar to the depth of field fora cell phone or tablet utilizing display 628.) This depiction helpsdefine the limits of the composition of scene S. Near plane point 1401and near plane point 1402 preferably lie within the depth of field,outer rays 1430, and near plane NP has to be outside the inner crossover position 1450 of outer rays 1430.

The motion from X1 to X2 is the motion user U eyes, left eye LE andright eye RE will track. Xn is distance from eye lens, left eye LE orright eye RE to image point 1411, 1412 on virtual near image plane 1410.X'n is distance of leg formed from right triangle of Xn to from eyelens, left eye LE or right eye RE to image point 1411, 1412 on virtualnear image plane 1410 to the image plane, 628, KS, KSP. The smoothmotion is the binocular disparity caused by the offset relative to keysubject KS at each of the points user U eyes, left eye LE and right eyeRE observe.

For each eye, left eye LE or right eye RE, a coordinate system may bedeveloped relative to the center of the eye CL and to the center of theintraocular spacing, half of interpupillary distance width IPD, 1440.Two angles β and α are the angles utilized to explain the DIFY motionpursuit. β is the angle formed when a line is passed from the eye lens,left eye LE and right eye RE, through the virtual near plane 1410 to theimage on the image plane, 628, KS, KSP. Θ is β2-β1. While α is the anglefrom the fixed key subject KS of the two frames 1101, 1104 on the imageplane 628, KS, KSP to the point 1411, 1412 on virtual near image plane1410. The change in α represents the eye pursuit. Motion of the eyeballrotating, following the change in position of a point on the virtualnear plane. While β is the angle responsible for smooth motion orbinocular disparity when compared in the left and right eye. The outerray 1430 emanating from the eye lens, left eye LE and right eye REconnecting to point 1440 represents the depth of field or edge of theimage, half of the image. This line will change as the depth of field ofthe virtual camera changes.

di/f=Xi

If we define the pursuit motion as the difference in position of a pointalong the virtual near plane, then by utilizing the tangents we derive:

X2−X1=di/(tan

∝1−tan∝2)

These equations show us that the pursuit motion, X2−X1 is not a directfunction of the viewing distance. As the viewing distance increases theperceived depth di will be smaller but because of the small angulardifference the motion will remain approximately the same relative to thefull width of the image.

Mathematically that the ratio of retinal motion over the rate of smootheye pursuit determines depth relative to the fixation point in centralhuman vision. The creation of the KSP provides the fixation pointnecessary to create the depth. Mathematically, then all points will movedifferently from any other point as the reference point is the same inall cases.

Referring now to FIG. 17 , there is illustrated by way of example, andnot limitation a representative illustration of Circle of Comfort CoCfused with Horopter arc or points and Panum area. Horopter is the locusof points in space that have the same disparity as fixation, Horopterarc or points. Objects in the scene that fall proximate Horopter arc orpoints are sharp images and those outside (in front of or behind)Horopter arc or points are fuzzy or blurry. Panum is an area of space,Panum area 1720, surrounding the Horopter for a given degree of ocularconvergence with inner limit 1721 and an outer limit 1722, within whichdifferent points projected on to the left and right eyes LE/RE result inbinocular fusion, producing a sensation of visual depth, and pointslying outside the area result in diplopia—double images. Moreover, fusethe images from the left and right eyes for objects that fall insidePanum's area, including proximate the Horopter, and user U will we seesingle clear images. Outside Panum's area, either in front or behind,user U will see double images.

It is recognized herein that computer system 10 via image captureapplication 624, image manipulation application 624, image displayapplication 624 may be performed utilizing distinct and separatelylocated computer systems 10, such as one or more user systems 220, 222,224 and application program(s) 206. Next, via communications link 240and/or network 250, wireless, such as 5G second computer system 10 andapplication program(s) 206 may transmit sets of images(n) of scene Srelative to key subject plane introduces a (left and right) binoculardisparity to display a multidimensional digital image on display 628 toenable a plurality of user U, in block or step 1250 to viewmultidimensional digital image on display 628 live or as areplay/rebroadcast.

Moreover, FIG. 17 illustrates display and viewing of multidimensionalimage 1010 on display 628 via left and right pixel 1550L/R light ofmultidimensional image 1010 passes through lenticular lens 1540 andbends or refracts to provide 3D viewing of multidimensional image 1010on display 628 to left eye LE and right eye RE a viewing distance VDfrom pixel 1550 with near object, key subject KS, and far object withinthe Circle of Comfort CoC and Circle of Comfort CoC is proximateHoropter arc or points and within Panum area 1720 to enable sharp singleimage 3D viewing of multidimensional image 1010 on display 628comfortable and compatible with human visual system of user U.

Blockchain is a shared, ledger that facilitates the process of recordingtransactions and tracking assets in a network. An asset can be tangible(title to a house, car, cash, land, artwork or DIGY, 3D Stereo, Datasetsthereof) or intangible (intellectual property, patents, copyrights,branding). A blockchain is a decentralized, distributed, and oftentimespublic, digital ledger consisting of records called blocks that are usedto record transactions across many computers using cryptography so thatany involved block cannot be altered retroactively, without thealteration of all subsequent blocks. This allows the participants toverify and audit transactions independently. Each block contains data orDataset, a cryptographic hash of the previous block (chain), atimestamp, and cryptographic hash (identifies block and all itscontent). The timestamp proves that the transaction data existed whenthe block was published to get into its hash. As blocks each containinformation about the block previous to it, they form a chain, with eachadditional block reinforcing the ones before it. Therefore, blockchainsare resistant to modification of their data because once recorded, thedata in any given block cannot be altered retroactively without alteringall subsequent blocks. If change a block then all following blocksinvalid and have a different hash. Secure through Proof of Workmechanism slows down transaction rate to create a new block plusdistributed. Blockchains are typically managed by a peer-to-peernetwork, an open and decentralized database, for use as a publiclydistributed ledger, where nodes collectively adhere to a protocol tocommunicate and validate new blocks. Each new block is sent to everyoneon the network to verify the new block creating a consensus. Althoughblockchain records are not unalterable as forks are possible,blockchains may be considered secure by design via a distributedcomputing system.

Ethereum is a popular block chain standard as well as other private andopen source blockchain algorithms.

DIGY, 3D Stereo, Datasets, and other datasets and any authenticationdocuments verify creator or author, authenticity statements, history,date of origin, chain of title, chain of owners, or like(authentication) may be included in the dataset (Dataset). Dataset maybe stored as a block on the blockchain network and each subsequenttransaction thereafter related to Dataset may be set forth in subsequentblocks each contains a cryptographic hash of the previous block, atimestamp of the Dataset transaction data decentralized source of trust.

Utilize Non-fungible tokens—For select DIGY, DIGY sequences, or Stereo3D image files, Datasets or other datasets—non-fungible tokens (NFT)sare unique collectible crypto assets stored on blockchain with uniqueidentification codes and metadata that distinguish DIGY, DIGY sequences,or Stereo 3D image file, Dataset, or dataset from any other digitalcontent making it unique one of a kind or limited edition digitalcontent. Enabling the creation of unique digital content and/or setnumbers of copies—a certificate of authenticity for a one-of-a-kind orlimited number of digital memorabilia that can't be duplicated. Thememorabilia is stored on a blockchain network. It's ‘non-fungible”because it can't be readily exchanged as similar reproducible contentfreely moving through the internet. Moreover, authenticating preciousart work utilizing DIGY, DIGY sequences, or Stereo 3D image file,Dataset of artwork along with appraisal, and any authenticationdocuments verify creator or author, authenticity statements, history,date of origin, chain of title, chain of owners, or like(authentication) may be included in the dataset (Dataset) and making ansmart contract or NFT of Dataset.

An NFT is simply a record of who owns a unique piece of digital content.That content can be anything from art, music, photograph, 3D graphics,tweets, memes, games, videos, GIFs—you name it. If it's digital and itwas created, it can be an NFT.

Current NFT digital content can be captured by a third party device andmass distributed via Internet by piracy and devalue the NFT digitalcontent of standard NFT content.

Digital content herein are DIGYs and 3D Stereo images generated byartist users and creating their own NFT artwork based on DIGYs and 3DStereo images using our DIGY and 3D Stereo platforms above.

Referring now to FIG. 18 , there is illustrated a flow diagram 1800 of amethod of creating an NFT for DIGY, DIGY sequence, Stereo 3D image file,or other data file(s) (Dataset).

In block or step 1810, opening, tapping, or launching app NFT(application program(s) 206) on Smart Device (computer system 10)represented by FIGS. 13 and 16B.

In block or step 1815, tapping/touching/selecting “Create NFT” on SmartDevice.

In block or step 1820, tapping/touching/selecting/accessing “DIGY/ DIGYsequence/Stereo 3D image file Library” icon on display 628 to accessimage files or the like on Smart Device.

In block or step 1825, tapping/touching/selecting a DIGY, DIGY sequence,Stereo 3D image file, or other data file(s) (Dataset) file from Librarymain storage device 214 of Smart Device 10.

In block or step 1830, tapping/touching/selecting “Create NFT” ondisplay 628 of Smart Device 10.

In block or step 1835, create NFT for selected image file—DIGY, DIGYsequence, Stereo 3D image file, or other data file(s) (Dataset). User ofSmart Device 10 via a system or App will utilize one of the blockchainproviders to issue an NFTs for their DIGY, DIGY sequence, Stereo 3Dimage file, or other data file(s) (Dataset). Ethereum is currently theleading blockchain service for NFT issuance. However, there is a rangeof other blockchains that are becoming increasingly popular. One may beoffered by Smart Device manufacture or other service provider.

In block or step 1840, utilize NFT token standard, compatible walletservices and marketplaces to offer for sale or exchange NFT of DIGY,DIGY sequence, Stereo 3D image file, or other data file(s) (Dataset).Once created user can offer their NFT, such as NFT-DIGY, DIGY sequences,or Stereo 3D image file for sale or verification on NFT compatiblewallet services and marketplace, such as OpenSea which is anEthereum-based NFT marketplace. Similar marketplace may be offered bySmart Device manufacture or other service provider.

DIGY, DIGY sequence, Stereo 3D image file, or other data file(s)(Dataset) are unique in that they can't be captured by a third partydevice such as another smart device viewing the DIGY, DIGY sequences, orStereo 3D since such devices do not have access to the original digitalfiles and may not have a license to the DIGY and 3D Stereo platforms.Current NFT digital content can be captured by a third party device andmass distributed via Internet by piracy and devalue the NFT digitalcontent of standard NFT content.

DIGY herein may include 2D video, 2D image collage, 3D DIGY.

A sequence is a plurality of DIGYS put together in series or a loop insequence to create a story.

Referring now to FIG. 19 , there is illustrated a flow diagram 1900 of amethod of linking or looping multiple DIGY—MP4 files in sequence or as aloop with or without audio files such as AAC (m4a) format, AIFF, AppleLossless, MP3, and WAV or other like audio formats stored there with.

In block or step 1910, opening, tapping, or launching app Photon3D(application program(s) 206) on display 628 of Smart Device (computersystem 10) represented by FIGS. 13 and 16B.

In block or step 1915, tapping/touching/selecting “Create DIGY sequence”on display of Smart Device 10.

In block or step 1920, tapping/touching/selecting “DIGY Library” icon ondisplay 628 to access, for example, DIGY MP4 files or the like on SmartDevice 10.

In block or step 1925, tapping/touching/dragging/selecting first DIGYfile from DIGY Library main storage device 214 of Smart Device 10 totime line.

In block or step 1930, tapping/touching/dragging/selecting second orplurality of DIGY file(s) from DIGY Library on display of Smart Device10 and placing them in sequence or desired order.

In block or step 1935, trimming/editing/cropping DIGY file(s) or setduration (start/stop/speed). Arrange DIGY(s) by settingtransitions/cuts. Add optional audio files/sound FX as a second audiotrack and mix sound amplitude.

In block or step 1940, reordering DIGY file(s) bytapping/touching/selecting/dragging by dragging DIGY file(s) to adifferent order or position is sequence.

In block or step 1945, saving completed DIGY sequence—MP4 bytapping/touching/selecting Save to save completed image and audio MP4file in main storage device 214 of Smart Device 10.

In block or step 1950, viewing and listening to completed DIGYsequence—MP4 file on Smart Device (computer system 10).

In block or step 1955, sharing DIGY sequence—MP4 file may be attached toan email or text, air dropped, or uploaded to social media to share.

It is contemplated herein that a user of may match the transitionsbetween two different DIGYs whether manually or programmaticallyimplemented using audio peak detection or even a time signature/tempomatching algorithm BPM: 120 beats per minute; Time signature: 4/4. 4bars=4 sections (DIGYs) with 3 transitions. [DIGY1−DIGY 2−DIGY3−DIGY4].4 bars×4 beats per bar=16 beats; 16 beats @ 120 bpm=8 seconds; 4sections (DIGY) @ 2 seconds per section=8 seconds. 1 DIGY per section=4DIGYs.

It is contemplated herein that a user of may use transient detection tofind the downbeat at the beginning of the measure and then synchronizedthis up with the start of the first DIGY. Each DIGY is trimmed to 2seconds then sequenced together to match the music transitions of thesequenced DIGYs.

Referring now to FIG. 20 , there is illustrated a flow diagram 2000 of amethod of manipulating a DIGY or DIGY sequence image file to synchronizewith an audio file.

In block or step 2010, opening, tapping, or launching the app Photon3D(application program(s) 206) on display 628 of Smart Device (computersystem 10) represented by FIGS. 13 and 16B.

In block or step 2015, tapping/touching/selecting “Music App” via inputto display 628 of Smart Device 10.

In block or step 2020, tapping/touching/selecting DIGY, DIGY sequence,Stereo 3D image file (Dataset) via input to display 628 of Smart Device10 to select a Dataset file from memory device 604, 606 via an inputfrom said display 628.

In block or step 2025, executing an instruction 206 via processor 102 toprepare, convert DIGY.gif file to DIGY.mps file via an input from saiddisplay 628; to create a DIGY frame time line via an input from display628; to import image frames (3D DIGY, 2D Images, 2D video) into saidframe time line via an input from said display 206; to adjustsequence/frame dwell time, via an input from said display 206.

In block or step 2030, executing an instruction 206 via processor 102 torecord an audio files via microphone in Smart Device 10, select an audiofile from memory device 604, 606 or online service, such as ITUNES viaan input from said display 628 and import or download audio file to timeline via an input from said display 628. It is contemplated herein thatDIGY sequence and audio file may be converted to .mp4 file for sharingwith other Smart Devices 222 via network 250.

In block or step 2035, executing an instruction 206 via processor 102 todrag, overlay, or place audio file from memory device 604, 606 to DIGYframe time line via an input from display 628.

In block or step 2040, executing an instruction 206 via processor 102 toadjust, crop, link, or arrange audio file relative to DIGY image filevia an input from display 628.

In block or step 2045, saving completed image and audio file—MP4 bytapping/touching/selecting Save to save completed image and audio MP4file in main storage device 214 via an input from display 628.

In block or step 2050, play, viewing and listening to completed imageand audio file on Smart Device (computer system 10) via an input fromdisplay 628.

In block or step 2055, sharing DIGY and audio (file) may be attached toan email or text, air dropped, or uploaded to social media to share.

With respect to the above description then, it is to be realized thatthe optimum dimensional relationships, to include variations in size,materials, shape, form, position, movement mechanisms, function andmanner of operation, assembly and use, are intended to be encompassed bythe present disclosure.

The foregoing description and drawings comprise illustrativeembodiments. Having thus described exemplary embodiments, it should benoted by those skilled in the art that the within disclosures areexemplary only, and that various other alternatives, adaptations, andmodifications may be made within the scope of the present disclosure.Merely listing or numbering the steps of a method in a certain orderdoes not constitute any limitation on the order of the steps of thatmethod. Many modifications and other embodiments will come to mind toone skilled in the art to which this disclosure pertains having thebenefit of the teachings presented in the foregoing descriptions and theassociated drawings. Although specific terms may be employed herein,they are used in a generic and descriptive sense only and not forpurposes of limitation. Moreover, the present disclosure has beendescribed in detail, it should be understood that various changes,substitutions and alterations can be made thereto without departing fromthe spirit and scope of the disclosure as defined by the appendedclaims. Accordingly, the present disclosure is not limited to thespecific embodiments illustrated herein but is limited only by thefollowing claims.

1. A system to simulate a 3D image sequence from a series of 2D imagesof a scene, the system comprising: a smart device having: a memorydevice for storing an instruction; a processor in communication withsaid memory device configured to execute said instruction; a pluralityof digital image capture devices in communication with said processorand each of said plurality image capture devices configured to capture adigital image of the scene, said plurality of digital image capturedevices approximately positioned linearly in series within approximatelyan interpupillary distance width, wherein a first digital image capturedevices is positioned proximate a first end of said interpupillarydistance width, a second digital image capture devices is positionedproximate a second end of said interpupillary distance width, and anyremaining said plurality of digital image capture devices are evenlyspaced therebetween to capture a series of 2D images of the scene; and adisplay in communication with said processor, said display configured todisplay said a multidimensional digital image sequence.
 2. The system ofclaim 1, wherein said processor executes an instruction to save saidseries of 2D images of the scene in said memory device.
 3. The system ofclaim 2, wherein said processor executes an instruction to select saidseries of 2D images of said scene to make a DIGY.
 4. The system of claim3, wherein said processor executes an instruction to select an automatickey subject selection algorithm via an input from said display, whereinsaid processor identifies a key subject point in said series of 2Dimages of the scene, and each of said series of 2D images of the sceneis aligned by said processor to said key subject point, and all otherpoints in said series of 2D images of the scene shift based on a spacingof said plurality of digital image capture devices to generate amodified sequence of 2D images.
 5. The system of claim 3, wherein saidprocessor executes an instruction to select a manual key subjectselection algorithm via an input from said display, wherein saidprocessor enables a user to position an icon within said scene via aninput from said display to identify a key subject point in said seriesof 2D images of the scene, and each of said series of 2D images of thescene is aligned by said processor to said key subject point, and allother points in said series of 2D images of the scene shift based on aspacing of said plurality of digital image capture devices to generate amodified sequence of 2D images.
 6. The system of claim 3, wherein saidprocessor executes an instruction to select a key subject point in saidseries of 2D images of the scene via an input from said display.
 7. Thesystem of claim 1, wherein said processor executes an instruction todefine two or more planes for each of said series of 2D images of thescene, wherein said two or more planes have different depth estimate. 8.The system of claim 7, wherein said processor executes an instruction toidentify a first proximal plane and a second distal plane within saidseries of 2D images of the scene.
 9. The system of claim 8, wherein saidprocessor executes an instruction to determine a depth estimate for saidfirst proximal plane and said second distal plane within said series of2D images of the scene.
 10. The system of claim 9, wherein saidprocessor executes an instruction to horizontally and vertically alignsaid first proximal plane of each image frame in said series of 2Dimages and shifting the second distal plane of each subsequent imageframe in the sequence based on the depth estimate of the second distalplane for said series of 2D images of the scene to produce a secondmodified sequence of 2D images.
 11. The system of claim 8, wherein saidfirst proximal plane and said second distal plane further comprising atleast a foreground plane and a background plane.
 12. The system of claim10, wherein said processor executes an instruction to align said secondmodified series of 2D images sequentially in a palindrome loop as amultidimensional digital image sequence.
 13. The system of claim 12,wherein said processor executes an instruction to save saidmultidimensional digital image sequence to said memory.
 14. The systemof claim 13, wherein said processor executes an instruction to record anaudio file via a microphone in communication with said processor. 15.The system of claim 14, wherein said processor executes an instructionto save said audio file to said memory.
 16. The system of claim 15,wherein said processor executes an instruction to select amultidimensional digital image sequence from said memory via an inputfrom said display and to display said multidimensional digital imagesequence on said display.
 17. The system of claim 16, wherein saidprocessor executes an instruction to select a audio file from saidmemory via an input from said display and to overlay said audio file onsaid multidimensional digital image sequence on said display.
 18. Thesystem of claim 17, wherein said processor executes an instruction tocrop said audio file to align with said multidimensional digital imagesequence via an input from said display.
 19. The system of claim 18,wherein said processor executes an instruction to save said audio fileand said multidimensional digital image sequence via an input from saiddisplay.
 20. The system of claim 19, wherein said processor executes aninstruction to play said audio file and display said multidimensionaldigital image sequence via an input from said display.
 21. The system ofclaim 20, wherein said processor executes an instruction to share saidaudio file and said multidimensional digital image sequence via an inputfrom said display with a second smart device via an input from saiddisplay.
 22. The system of claim 20, wherein said processor executes aninstruction to generate a non-fungible token of said audio file and saidmultidimensional digital image sequence with a second smart device viaan input from said display
 23. The system of claim 22, wherein saidprocessor executes an instruction to utilize a wallet service and amarketplace to exchange said non-fungible token of said audio file andsaid multidimensional digital image sequence via an input from saiddisplay.